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Abstract 

Hi  optimization  with  convex  constraints  is  considered.  The  optimal  (order- 
firee)  solution  is  shown  to  be  unique  through  convex  analysis.  Hgo  constraints 
with  feedforward  terms  and  singular  constraints  (those  with  no  direct  control  us¬ 
age  penalty  or  perfect  measurements  and  those  with  associated  Hamiltonions  that 
have  yti;-axis  zeros)  sure  also  allowed.  The  optimal  fixed-order  solution  is  shown  to 
have  the  same  characteristics  aw  a  mixed  problem  with  regidar  Hoo  constraints.  Fur¬ 
thermore,  these  results  are  shown  to  hold  for  controller  orders  as  low  as  the  optimal 
Hi  order.  A  numerical  method  is  developed  based  on  analytical  gradients  which 
results  in  sub-  and  super-optimal  fixed-order  controllers.  The  problem  is  extended 
to  include  an  upper  bound  on  a  /<  constraint  through  a  modification  of  the  D-K  iter¬ 
ation  method.  Next,  multiple  H^o  constraints  are  developed.  Fixed-order  solutions 
to  the  multiple  constraint  problem  are  characterized  and  the  numerical  method  is 
extended  to  include  multiple  constraints.  Next,  a  continuous  L\  constraint  is  added. 
A  numerical  approach  is  proposed  based  on  hounding  the  Zi-norm  by  the  /i-norm 
of  an  Euler  approximating  system.  Finally,  Hi  optimization  with  a  finite  set  of 
H^,  /t,  and  L\  constraints  is  characterized.  SISO  and  MIMO  numerical  examples 
demonstrate  the  application  of  these  methods. 
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Hi  OPTIMAL  CONTROL  WITH  AND  Li  CONSTRAINTS 


I.  Introduction 

1.1  Overview 

Controller  design  for  a  nonlinear  system  is  often  based  on  a  linear,  time- 
invariant  model  of  the  system  as  it  operates  near  an  operating  point  or  nominal. 
While  this  approach  simplifies  the  design  process  and  aUows  powerful  tools  and 
techniques  to  be  applied,  there  are  distinct  drawbacks  to  the  method  due  to  the 
imprecise  modeling  of  a  nonlinear  system  by  a  linear  model.  Moreover,  the  model  is 
assumed  to  be  time-invariant,  and  thus  cannot  account  for  changes  in  the  system  that 
are  time-dependent.  One  can  argue  that  the  primary  purpose  of  feedback  control  is 
to  provide  stability  in  light  of  any  unmodeled  dynamics  and  system  perturbations. 
A  second,  but  just  as  important,  use  of  feedback  control  is  to  provide  some  desired 
level  of  system  performance. 

Due  to  the  nature  of  the  control  problem,  the  design  process  is  broken  dovm 
into  two  categories,  each  of  which  has  two  parts.  This  first  category  is  to  provide 
nominal  control — that  is,  to  provide  stability  and  performance  for  the  nominal  linear 
model.  Consider  the  linear  system  in  Figure  1.1  where  w(s)  is  an  exogenous  input 
and  z(8)  is  the  output  which  we  are  trying  to  control  (not  necessarily  realizable).  The 
plant  P(8)  is  based  on  some  underlying  linear  model  6(5)  which  transfers  the  control 
u(8)  to  the  measured  output  y(s).  K(s)  is  a  linear,  time-invariant  controller  which 
has  the  measured  output  y(8)  as  its  input  and  the  control  u(8)  is  its  output.  Nominal 
staMxly  is  achieved  if  the  closed-loop  system  in  Figure  1.1,  where  the  feedback  loop 
is  closed  with  the  controller  K(8),  is  asymptotically  stable.  If  we  only  consider  the 
underlying  linear  model  with  no  input  to  the  system  (P(8)=G(s),  z(s)=y(s),  and 
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Figure  1.1.  General  nominal  block  diagram 


w(8)=0),  this  requirement  is  met  if  the  poles  of  P(s)[/  —  P(a)A'(a)]“^  lie  in  the  open 
left-half  complex-plane.  A  broader  concept  of  internal  stability  will  be  explored  later, 
but  is  equivalent  for  this  closed-loop  system. 

For  the  nominal  performance  problem,  z(s)  generally  differs  from  y(8)  and  w(s) 
is  not  zero;  thus,  P(8)  is,  in  general,  not  equal  to  G(s).  It  is  assumed  that  ?(&)  is 
known  and  w(8)  is  some  exogenous  input  with  known  properties  such  as  white  noise 
of  fixed  intensity  or  a  deterministic  signal  with  bounded  energy.  Some  performance 
measure  is  defined  and  the  nominal  performance  problem  is  to  find  a  K(s)  which 
provides  nominal  stability  and  an  acceptable  level  of  the  performance  measure.  If 
the  performance  problem  can  be  expressed  as  a  mathematical  program  over  the  set  of 
possible  controllers,  the  minimization  or  maximization  problem  is  called  an  optimal 
control  problem. 

Robust  control  is  the  second  category  the  designer  must  consider.  In  this 
problem,  the  systems  under  consideration  are  every  element  Vi  in  the  set  V  :=  P{b)+ 
AP  where  AP  is  a  set  of  unknown  perturbation  to  the  nominal  plant.  The  robust 
stabUity  problem  is  to  design  a  controUer  K(s)  which  provides  asymptotic  stability 
for  every  Vi.  One  way  to  consider  this  problem  is  to  combine  all  the  perturbations 
to  the  system  into  a  single  unstructured  perturbation  A(s),  which  has  input  e(s)  and 
output  d(s)  which  are  outputs  and  inputs  of  P(s),  respectively.  The  resulting  system 
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Figure  1.2.  General  perturbed  block  diagram 


is  shown  in  Figure  1.2.  Then,  robust  stability  requires  K(s)  to  internally  stabilize 
the  system  for  all  possible  A(a). 

Finally,  the  feedback  controller  should  provide  some  measure  of  robust  perfor- 
mance-that  is,  produce  a  controller  K(s)  which  internally  stabilizes  the  closed-loop 
system  and  provides  an  acceptable  measure  of  performance  under  all  expected  plant 
perturbations.  This  problem  is  not  as  easy  to  handle  as  the  previous  problems,  but 
ft-synthesis  is  generally  acknowledged  as  the  best  approach  to  solving  the  robust 
performance  problem  [1,  2].  /i-synthesis  is  based  on  exploiting  the  known  structure 
of  the  perturbation  A  smd  will  be  developed  latex  in  this  work. 

The  performance  of  a  system  is  often  measured  by  the  maximum  energy  of  some 
controlled  output  due  to  some  specified  input.  One  example  is  the  familiar  lineu 
quadratic  Gaussian  (LQG)  control  problem,  where  the  exogenous  input  is  zero-mean, 
white  Gaussian  noise  of  unit  intensity.  This  problem  is  equivalent  to  minimizing  the 
two-norm  of  the  transfer  function  from  the  input  to  the  output  and  is  referred  to  as 
ffa  optimization.  Another  measure  of  performance  is  the  model  matching  problem, 
where  it  is  desired  to  minimize  the  energy  of  the  controlled  output  resulting  from 
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Figure  1.3.  Mixed  block  diagram 


some  exogenous  but  bounded  energy  input.  This  is  equivalent  to  minimizing  the 
infinity-norm  of  the  transfer  function  from  the  input  to  the  output  and  is  referred  to 
as  Hoa  optimization.  An  example  of  this  problem  is  the  weighted  sensitivity  problem, 
which  will  be  discussed  in  detail  later. 

In  general,  it  will  be  desirable  to  solve  both  the  LQG  and  model  matching 
problems  concurrently  for  a  given  system,  thus  leading  to  a  multi-objective  or  mixed 
optimal  control  problem.  Consider  the  system  in  Figure  1.3,  where  the  transfer 
function  from  w  to  z,  Tj«„  is  associated  with  the  LQG  problem  and  the  transfer 
function  from  d  to  e,  Ted%  represents  the  model  matching  problem.  The  problem 
now  is  to  find  an  internally  stabilizing  K(s)  which  minimizes  ||Tx„||3  for  some  level  of 
model  matching,  ||Te((||oo  ^  7*  This  implies  a  potential  trade-off  exists  between  the 
two  measures  of  performance.  Furthermore,  robustness  has  not  yet  been  considered. 

To  add  robust  stability  to  the  above  problem,  the  Smrdl  Gain  Theorem  can  be 
used.  Define  Hgo  ns  the  space  of  all  transfer  functions  which  are  analytic  and  bounded 
in  the  closed  right-half  complex-plane.  Internal  stability  implies  that  all  the  states 
of  the  system  are  asymptotically  stable  (the  concept  of  internal  stability  will  be 
developed  more  in  Chapter  II).  Then  the  following  theorem  gives  us  a  condition  for 
stability  robustness. 
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Figure  1.4.  Perturbed  stability  diagram 


Theorem  1.1.1  (Small  Gain  Theorem)  Let  Ted  £  Hoo-  Assume  A  €  Heo  is  con¬ 
nected  from  e  to  d  as  shovm  in  Figure  Then  the  closed-loop  system  is  internally 
stable  if 

||T,,(s)A(s)|loc  <  ||rea(s)|U|lA(3)||oo  <  1  (1.1) 


Proof:  See  [3].  ■ 

Therefore,  as  ||T«{||ao  is  decreased,  a  larger  level  of  unstructured  uncertainty 
can  be  allowed  and  internal  stability  still  be  guaranteed.  Thus,  robust  stability  can 
be  incorporated  into  the  mixed  problem  using  an  Hoo  constraint.  However,  this 
measure  of  robustness  is  conservative  since  it  does  not  account  for  the  structure 
of  the  perturbations  :md  only  provides  information  for  the  worst  case  frequency. 
Through  /t-synthesis,  a  less  conservative  mezisure  of  robust  stability  cem  be  added  to 
the  mixed  problem  by  exploiting  the  structure  and  frequency  content  of  the  pertur¬ 
bation.  Moreover,  /t-synthesis  can  be  used  to  add  robust  performance  into  the  mixed 
problem.  While  Hoo  optimization  and  /t-synthesis  provide  powerful  techniques  for  de¬ 
signing  optimal  controllers,  both  methods  have  limitations.  In  general,  the  methods 
tend  to  result  in  high  bandwidth  controllers  and  thus  have  increased  high  frequency 
noise  response.  A  slight  increase  in  the  infinity-norm  often  results  in  a  substantial 
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reduction  in  the  high  frequency  response,  which  demonstrates  an  available  trade-off 
which  will  be  exploited  in  the  mixed  problem. 


Finally,  /Too  and  /t-synthesis  are  based  on  bounded  energy  inputs  £uid  outputs. 
It  is  often  the  case  that  the  designer  is  interested  in  bounding  the  magnitude  of 
a  controlled  output  due  to  a  worst  case  bounded  magnitude  input.  This  is  par¬ 
ticularly  important  when  considering  surface  deflections  and  aircraft  rotation  rates 
where  physical  hmitations  are  not  modeled  by  the  linear  system.  Li  optimal  control 
can  handle  this  control  problem.  This  technique  minimizes  the  magnitude  of  the 
controlled  output  due  to  an  exogenous  but  bounded  magnitude  input  by  minimizing 
the  Xi-norm  of  the  resulting  transfer  function.  Moreover,  we  can  replace  the  infinity- 
norm  in  the  above  discussion  with  the  one-norm,  and  the  robustness  properties  hold. 
Thus,  we  desire  a  method  of  including  Li  constraints  into  the  mixed  optimization 
problem. 


To  solve  the  mixed  control  problem,  the  Hi  problem  will  be  selected  as  the 
objective  function.  Throughout  this  dissertation,  we  will  assume  the  Hi  problem 
has  tractable  solutions.  To  incorporate  a  desired  level  of  robustness  and/or  nominal 
performance,  an  inequaUty  constraint  will  be  appended  to  the  Hi  problem.  Thus, 
the  problem  to  be  addressed  in  this  dissertation  is:  Find  an  internally  stabilizing 
K(s)  that  achieves 


K  (  §)tttibUizing 


.11. 


(1.2) 


where  a  =  {oo,/i,  1}  and  7  is  fixed  a  priori  and  is  based  on  the  desired  level  of  ro¬ 
bustness  and/or  nominal  performance.  This  problem  is  a  mathematical  progreunming 
problem  which  can  be  approached  using  the  rich  theory  which  exists  for  optimization 
problems. 


There  has  been  a  great  deal  of  interest  in  the  mixed  Hi/ Hex,  problem  and 
variations  on  it  with  simplifying  assumptions.  This  work  will  take  the  most  general 
approach  to  date  and  remove  some  of  the  remaining  simplifying  assumptions.  In 
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addition,  the  mixed  framework  will  be  extended  to  a  more  general  multi-objective 
problem.  First,  a  review  of  previous  work  is  necessciry  to  set  the  stage. 

1.2  Review  of  Related  Work 

1.2.1  Mixed  H^/Hoo  vjith  a  single  input  or  single  output.  The  initial 
approaches  to  the  mixed  objective  control  problem  were  taken  on  a  subset  of  the 
problem  given  in  Figure  1.3,  where  it  is  assumed  that  either  d  =  w  ot  z  =  e. 
Bernstein  and  Haddad  [4]  presented  one  of  the  earhest  formulations  of  the  problem 
Mrith  d  =  w.  Their  formulation  used  a  Lagrange  multiplier  approach  and  resulted 
in  necessary  conditions  for  a  fixed-order  controller  which  provides  an  overbound 
to  the  Hi  problem  and  satisfies  the  Hoo  constraint.  The  controller  order  must  be 
determined  a  priori.  While  this  technique  edlows  reduced  order  controllers  which  are 
desirable,  it  does  not  provide  conditions  for  determining  the  order  of  the  controller 
which  is  globally  optimal.  Zhou,  et  al,  [5,  6]  formed  the  mixed  problem  for  two 
independent  inputs  with  e  =  z.  Their  approach  defined  a  new  performance  index 
which  reduced  to  the  Hi  performance  index  when  d  =  0  and  the  Hoo  performance 
index  when  w  =  0.  If  both  inputs  are  non-zero,  a  mixed  performsmce  index  is 
obtained.  Necessary  and  sufficient  conditions  for  the  existence  of  a  mixed  controller 
were  derived  and  controllers  were  parametrized  through  a  set  of  coupled  matrix 
equations.  Yeh,  et  al  [7],  showed  that,  when  the  order  of  the  controller  is  fixed  to 
that  of  the  plant,  the  results  of  the  above  two  works  are  the  duals  of  each  other. 

1.2.2  General  Mixed  Hi /Hoo  optimization.  Rotea  and  Kh2irgonekar  [8] 
presented  the  first  attempt  ot  solving  the  general  problem  shown  in  Figure  1.3,  where 
no  relationship  is  assumed  between  d  and  w  or  e  and  z.  Their  formulation  was  based 
on  full  state  availability  only.  In  addition,  their  approach  was  nonconservative  in 
reguds  to  optimizing  the  actual  Hi  norm,  rather  than  just  providing  an  overbound 
to  the  norm.  Ridgely,  et  al  [9,  10],  added  output  feedback  into  the  formulation  of 
the  general  mixed  optimal  control  problem.  They  derived  the  necessary  conditions 
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for  an  optimal  fixed-order  controller.  The  formulation  assumed  a  strictly  proper, 
regular  Hoo  constraint.  In  addition,  Ridgely,  et  al,  developed  a  numerical  solution 
which  requires  unique  solutions  to  Lyapunov  equations  and  stabilizing  solutions  to 
Riccati  equations.  A  homotopy  method  was  used  between  the  central  Hgo  problem 
[11]  and  the  optimal  mixed  problem.  The  method  was  shown  to  converge  to  the 
optimal  mixed  problem. 

The  above  approaches  axe  based  on  a  single  H2  and  a  single  Hoo  transfer 
function.  Schomig,  et  al,  [12]  developed  a  time  domain  approach  for  solving  the 
mixed  problem  with  multiple  transfer  functions.  The  approach  combined  the  optimal 
Hi  problem  with  a  penalty  function,  which  incorporates  the  Hoo  constraint.  A  fixed- 
order  controller  and  a  finite  final  time  were  used.  The  resulting  controller  approaches 
a  controller  which  infimizes  a  linear  combination  of  Hi  performance  bounds  while 
satisfying  a  set  of  Hoo  constraints  as  the  final  time  approaches  infinity.  However, 
there  was  no  attempt  to  characterize  the  optimal  controller  or  provide  conditions  for 
its  existence. 

All  of  the  above  works  based  their  results  on  a  fixed-order  controller  with  order 
equal  to  the  plant  order. 

1.2.3  Mixed  Hi/fi  optimization.  Madiwale  [13]  first  proposed  adding  ro¬ 
bustness  to  the  mixed  control  problem.  His  approach  was  based  on  the  work  of 
Bernstein  and  Haddad  [4],  and  thus  only  provides  em  overbound  to  the  Hi  portion. 
However,  his  development  does  attempt  to  provide  robustness  to  both  the  Hi  and 
Hoo  performance.  B^unbang,  et  al,  [14]  presented  a  static  state  feedback  solution  to 
the  mixed  Hilp,  problem  based  on  the  work  of  Rotea  and  Khsirgonekar  [15].  Both  of 
these  approaches  oidy  address  a  subproblem  due  the  restrictive  assumptions  on  the 
inputs,  outputs,  and  controller. 

Hall  and  How  [16]  used  a  dissipative  system  approach  to  develop  a  worst  case 
bound  on  Hi  robust  performance  for  a  system  with  uncertainty.  Their  work  gener- 
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alizes  a  measure  of  robust  performance  to  the  framework.  However,  it  does  not 
address  a  mixed  norm  approach  to  the  optimization. 

l.S  Research  Objectives  and  Contributions 

The  purpose  of  this  research  is  to  first  explore  the  nature  of  the  optimal  solution 
to  the  mixed  Hj/Hoo  optimal  control  problem.  Next,  the  set  of  problems  which 
can  be  handled  by  the  mixed  H2/Hoa  optimal  control  problem  will  be  extended 
beyond  the  set  discussed  in  the  previous  section.  Furthermore,  formal  incorporation 
of  multiple  Hoo  constraints  and  ft  into  the  general  framework  will  be  accomplished. 
A  general  numerical  approach  for  fixed-order  controllers  will  be  developed.  Finally, 
the  Hi  problem  with  a  finite  set  of  convex  constraints,  including  Hoo,  and  Li,  will 
be  examined. 

The  first  contribution  of  this  dissertation  will  be  to  characterize  the  optimal 
controller  for  a  mixed  Hi  J Hoo  optimization  problem  where  the  controller  order  is 
not  assumed  a  priori  but  allowed  to  be  free.  It  will  be  shown  that  the  optimal 
solution  is  unique  by  approaching  the  problem  through  convex  progreunming.  More¬ 
over,  necessary  conditions  for  optimality  will  be  derived.  Next,  a  dual  approach  to 
computing  the  optimal  controller  will  show  that  the  optimal  controller  for  a  class  of 
mixed  Hi  J  Hoo  problems  is  a  non- rational  Hi  function.  Furthermore,  this  method 
will  be  used  to  develop  an  analytical  method  for  determining  the  minimum  two-norm 
for  a  fixed  7  for  a  class  of  mixed  Hi! Hoo  problem. 

The  second  contribution  of  this  work  is  to  extend  the  set  of  Hoo  constraints 
which  can  be  handled  by  the  fixed-order  mixed  problem.  As  discussed  in  Section  1.2, 
previous  methods  for  solving  the  fixed  order  Hi/ Hoo  problem  have  been  based  on  the 
assumptions  that  the  Hoo  constrmnt  is  non-singrdar  and  strictly  proper.  However, 
it  is  often  desirable  to  allow  both  singular  and  non-strictly  proper  constraints.  A 
common  example  of  this  is  the  weighted  sensitivity  problem,  which  is  singular  and 
can  also  be  non-strictly  proper.  Thus,  the  set  of  allowable  Hoo  constraints  will  be 
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expanded  to  include  sing  alar  constraints  as  well  as  non- strictly  proper  ones.  Fur¬ 
thermore,  for  practical  applications,  the  order  of  the  controller  must  be  as  low  as 
possible.  Previous  approaches  to  the  general  mixed  problem  have  assumed  the  con¬ 
troller  order  is  equal  to  or  greater  than  the  order  of  the  plant  augmented  with  both 
the  and  Hgo  weighting  transfer  functions.  It  will  be  shown  that  the  conditions 
developed  for  a  ftxed-order  solution  in  this  work  hold  for  a  controller  order  as  low  as 
the  order  of  the  problem  alone. 

Next,  a  numerical  approach  for  finding  fixed-order  controllers  in  the  neighbor¬ 
hood  of  the  optimal  fixed-order  controller  will  be  developed.  This  approach  has  the 
advantage  (over  previous  methods)  of  handling  singular  Hoo  constraints  emd  those 
with  a  feedforward  term.  Furthermore,  the  order  of  the  solutions  can  be  reduced  to 
greater  than  or  equal  to  that  of  the  ifj  problem.  Finally,  the  computation  time  for 
the  new  method  is  significantly  reduced  from  that  of  the  existing  method. 

The  fourth  contribution  of  this  work  is  to  extend  the  method  to  include  incor¬ 
porate  /x-synthesis  into  the  framework.  This  will  allow  a  less  conservative  measure 
of  robust  stability  and  also  allow  robust  performance  to  be  included  in  the  mixed 
framework. 

The  next  contribution  is  to  extend  the  above  results  to  mixed  problems  with 
multiple  Hoo  constraints.  The  uniqueness  of  the  optimal  controller  is  shown  and  nec¬ 
essary  conditions  for  order-free  and  fixed-order  solutions  will  be  developed.  Further¬ 
more,  numerical  approaches  for  finding  solutions  to  the  multiple  constraint  problem 
are  given. 

The  last  contribution  will  show  that  siny  finite  set  of  convex  constraints  can 
be  augmented  to  the  H3  optimization  problem  in  the  framework  developed  in  this 
dissertation.  First,  the  H^/Li  problem  will  be  set  up  and  a  numerical  approach  for 
designing  fixed-order  controllers  will  be  given.  This  allows  the  mixed  approach  to 
be  applied  to  bounded  magnitude  outputs.  Finally,  the  framework  will  be  expanded 
to  allow  Hi  problems  with  a  finite  set  of  H001  and  l\  constraints.  It  will  be 
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shown  that  all  these  constiaints  can  be  augmented  and  the  problem  solved  in  an 
analogous  manner  to  the  multiple  Hoo  constraint  problem.  Thus,  all  the  design 
methodologies  discussed  in  this  work  can  be  combined  into  a  single  problem  allowing 
the  design  engineer  a  wide  latitude  in  setting  up  competing  objectives  for  synthesizing 
a  controller  which  provides  nominal  and  robust  stability  and  performance. 

1.4  Outline 

This  dissertation  consists  of  10  chapters  including  this  introduction.  Chapter 
2  will  present  some  necessary  mathematical  review,  including  a  discussion  of  lineeir 
vector  spaces,  Lyapunov  and  Riccati  equations,  convex  programming,  and  minimum 
norm  duality  theory.  Next,  Chapter  3  will  review  H2  and  Hoo  optimization  tech¬ 
niques  and  present  an  introduction  to  /^-synthesis. 

Chapter  4  will  develop  the  key  theoretical  results  for  mixed  Hi/ Hoo  optimiza¬ 
tion.  To  begin,  the  set  of  all  stabilizing  controllers  will  be  parametrized  over  a  convex 
set.  Then,  the  uniqueness  of  the  optimal  controller  will  be  shown  through  convex 
analysis.  Furthermore,  a  duality  approach  to  the  minimum  norm  problem  will  be  de¬ 
veloped  to  characterize  the  optimal  controller.  This  development  will  solve  a  special 
case  of  the  optimal  problem  with  a  particular  form  of  the  Hoo  constraint. 

Fixed-order  solutions  to  the  mixed  problem  will  be  addressed  in  Chapter  5. 
A  Lagrange  multiplier  approach  will  be  taken  by  appending  a  Lyapunov  equation 
associated  with  the  H2  problem  and  a  Riccati  equation  associated  with  the  Hoo  con¬ 
straint.  This  development  will  allow  singular  and  non-strictly  proper  Hoo  constraints, 
and  can  handle  controllers  with  order  fixed  to  greater  thzm  or  equal  to  the  H2  prob¬ 
lem.  Chapter  6  will  develop  a  numerical  method  based  in  the  frequency  domain 
which  computes  fixed-order  controllers  in  the  neighborhood  of  the  optimal.  The  re¬ 
sulting  algorithm  will  be  demonstrated  through  the  design  of  a  single  input/single 
output  (SISO)  F-16  longitudinal  controller. 
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Robust  performance  will  be  added  into  the  framework  in  Chapter  7  by  incorpo¬ 
rating  /i-synthesis  into  the  mixed  Ht/Hoo  optimal  control  problem.  The  fixed-order 
controller  will  be  characterized  and  the  trade-off  between  robustness  and  disturbance 
rejection  will  be  demonstrated  through  an  F-16  normal  acceleration  control  problem 
and  a  multiple  input /multiple  output  (MIMO)  HIM  AT  pitch  control  design  example. 

The  utility  of  the  mixed  problem  will  be  further  increased  in  Chapter  8  by  in¬ 
cluding  multiple  Hoo  constraints.  First,  the  uniqueness  of  the  optimal  controller  will 
be  addressed  and  the  question  of  existence  will  be  discussed.  Next,  the  fixed-order 
solution  will  be  developed  and  the  nature  of  fixed-order  controllers  with  order  greater 
than  or  equal  to  the  H2  problem  will  be  characterized.  The  numerical  approach  from 
Chapter  6  will  be  modified  to  handle  multiple  constraints,  and  methods  for  finding 
controllers  will  be  developed.  Finally,  an  F-16  normal  acceleration  exzunple  will  be 
used  to  demonstrate  the  power  of  the  multiple  constraint  optimization. 

In  Chapter  9,  an  approach  to  H2IL1  problems  will  be  developed.  Suggestions 
on  how  to  extend  this  work  to  include  H2  optimization  with  any  combination  of 
ffooy  /*)  uid  Li  constraints  will  be  discussed.  Finally,  Chapter  10  presents  some 
conclusions  and  recommendations. 
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11.  Mathematical  Preliminaries 


2.1  State  Space  and  Transfer  Functions 

This  section  will  consider  linear,  time-invariant  systems  in  continuous  state 
space  form 

i(t)  =  Axit)  -1-  Bw{t) 
z(t)  =  Cz{t)  -t-  Dv}(t) 


or  in  discrete  state  space  form 


x(k  -1-1)  =  Adx(k)  -I-  Bdw(k) 
z{k)  =  Cdx(k)  -f  Ddw{k) 


where  A,Ad€  SI"’*’*,  B,Ba  e  Si"’*"*,  C,Cd  G  Si*”*",  and  D,Dd  G  Si*”*"*  are  constant 
matrices.  The  vectors  x  G  Si",  w  €  Si”,  and  z  G  Si**  are  the  state,  control,  and 
output  vectors,  respectively.  [•](<)  represents  functions  of  time  for  t  G  [0,-foo), 
[•](/;)  represents  sequences  with  index  k  G  {0, 1,2,. . .},  and  [•]  represents  the  time 
derivative  of  [•]. 

The  stability  of  systems  (2.1)  and  (2.2)  is  determined  by  the  eigenvalues  of  A 
or  Ad.  For  the  continuous  case,  the  system  is  stable  if  all  the  eigenvalues  of  A  are  in 
the  open  left-half  complex  plane;  the  system  is  neutrally  stable  if  the  eigenvalues  sure 
in  the  closed  left-half  complex  plane  and  at  least  one  eigenvalue  is  on  the  imaginary 
axis;  and  the  system  is  unstable  otherwise.  For  the  discrete  case,  the  system  is  stable 
if  all  the  eigenvalues  of  Ad  are  in  the  open  unit  disk  centered  at  the  origin;  the 
system  is  neutrally  stable  if  the  eigenvalues  are  in  the  closed  unit  disk  and  at  least 
one  eigenvalue  is  on  the  unit  circle;  and  the  system  is  unstable  othervrise. 

The  state  space  forms  can  be  realized  as  input-output  transfer  functions  in  the 
s-domain  for  the  continuous  case  through  the  Laplace  transform 


T^{s)  .=  C  {si  -  A)-^  B  +  D 


(2.3) 
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and  in  the  z-domain  for  the  discrete  case  through  the  z  transform 


T^{z)  :=  Ci  (zJ  -  Ai)-^  (2.4) 

For  the  remainder  of  this  section,  only  the  continuous  case  will  be  considered; 
similar  results  can  be  derived  for  the  discrete  case.  The  shorthand  notation 


A  B 
C  D 


:=  C{sI-Ay^B  +  D 


will  be  used.  Conversely,  for  any  real-rational,  proper  (i.  e.,  analytical  at  s  =  oo) 
transfer  function  there  exists  a  realization  (non-unique)  {A,  B,  C,  D)  such  that 


T  = 


A  B 
C  D 


The  realization  is  mininud  if  A  is  of  smallest  possible  dimension.  A  realization  is 
minimal  if  and  only  if  (A,  B)  is  controllable  and  (C,  A)  is  observable. 

The  following  definitions  and  properties  will  be  useful: 


TL{s)  := 


A^ 


T^i-s)  :=  1^- 

Fnrther,  the  conjugate  of  is  defined  by 

TM  ■■=  TU-s)  = 


-A 

B 

-C 

. 

D 

B^ 
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and 


Figure  2.1.  Nominal  feedback  system 


poles  [r^(s)]  =  poles  [Tj[,(«)]  =  -poles  [T^(-s)]  =  -poles  [T;;„(s)]  (2.10) 

For  €  C**’*'*,  let  /  =  min{m,p}.  The  singular  values  <r,-,  t  =  1, . . . ,  /,  satisfy 

(IW(*)1  =  <r<  [JZMi  =  <r,  (r„(-.))  =  (r;;.(,))  (2.11) 


To  complete  this  section,  consider  the  nominal  feedback  system  given  in  Fig¬ 
ure  2.1.  Let  P(s)  and  K(b)  be  known  proper  transfer  functions  matrices;  then 
Figure  2.1  represents 


• 

“ 

z 

=  p 

•w 

V  . 

u 

where  P  can  be  partitioned  as 


u  =  Ky 


P  = 


(2.12) 


(2.13) 


To  simplify  notation,  it  will  be  assumed  that  transfer  hinctions  and  signals  are 
functions-of-s  for  the  remainder  of  this  dissertation  unless  otherwise  stated.  If  P  and 
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K  aie  minimal  order,  then  the  closed-loop  transfer  function  can  be  determined 
from  the  lower  fractional  transformation  (LFT)  as 

T„  =  FtiP,  K)  ;=  +  P^K  (/  -  Py^K)-^  Py^  (2.14) 

Similarly,  an  upper  fractional  transformation  (UFT)  is  defined  for  some  block  A  with 
input  s  and  output  w  shown  in  Figure  2.2  as 

Ty^  =  F„(P,  A)  :=  +  P„«  A  (/  -  P^  A)-'  P^  (2.15) 

The  system  in  Figure  2.1  is  said  to  be  well  posed  if  and  only  if  (/  —  Py^K)  is 
invertible.  If  P^  or  K  is  strictly  proper  (i.  e.,  Pyu(oo)  =  0  or  K{oo)  =  0),  as  will  be 
assumed  in  this  work,  then  the  system  is  well  posed. 

The  system  in  Figure  2.1  can  be  written  in  state  space  form  as 


A 

Bu 

A, 

Be 

p  — 

c, 

Cy 

Dy^ 

D,u 

Dyu 

K  = 

(2.16) 

A  — 

Cc 

Be 
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The  well  posedness  of  the  system  can  now  be  seen  as  (7  —  Z)c7?yu)  being  invertible. 
Fnrthermore,  the  closed-loop  transfer  function  can  be  written  in  state  space  form 


as 

where 

A 

B 

C 

V 


T  = 


A 

B 

C 

V 

A  -I-  -  DcD^)-^DcCy  B„(7  - 

Bc(I  -  Dy^D.Y^Gy  A  +  Bc{I  -  DyuDcY^Dy^Cc 


Bu,  -|-  Bfli^I  —  DcDyu)  ^  DcDyu, 

Bci^I  Dy^Dc)  ^  Dyui 

[  c,  +  D,^D,{I  -  Dy^D.Y^Cy  D^{I  -  D^Dy^Y'Cc 
[Dgui  +  DgaDe{I  —  DyuDc)  *7)yu;] 


(2.17) 


(2.18) 


(2.19) 

(2.20) 
(2.21) 


Thus,  given  a  realization  of  the  open-loop  system  and  the  feedback  controller,  we 
can  always  determine  the  resulting  closed-loop  transfer  function. 


2.2  SiabUxty  Theory 

This  section  will  exzunine  the  stability  of  open-  and  closed-loop  systems  amd 
give  some  useful  theorems  relating  to  internal  stability.  The  open-loop  system  (2.1) 
is  said  to  be  stcble  if  the  A  matrix  is  stable.  Similarly,  the  closed-loop  system  is  said 
to  be  internally  stable  if  the  closed-loop  A  matrix  defined  by  (2.18)  is  stable.  The 
following  theorems  give  some  conditions  for  internal  stability. 

Theorem  2.2.1  Assume  the  realization  of  Pin  (2.16)  is  minimal.  Then  there  exists 
a  proper  K  which  achieves  internal  stability  for  the  system  in  Figure  2.1  iff  (A,  .^u) 
is  stabilizable  and  (Cy,  A)  ts  detectable. 

Proof:  See  [17],  Chapter  4.  ■ 
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A  controller  K  which  achieves  internal  stability  is  said  to  be  a  stabilizing  controller. 
If  such  a  K  exists,  then  P  is  said  to  be  stabHizable. 


Theorem  2.2.2  K  is  a  stabilizing  controller  for  P  iff  K  is  a  stabilizing  controller 
for  P^. 

Proof:  See  [17],  Theorem  4.2.  ■ 

Thus,  from  Theorem  2.2.2,  only  Py^  must  be  considered  for  analyzing  the 
internal  stability  of  a  system.  Internal  stability  can  now  be  viewed  as  bounded 
input-bounded  output  stability  for  the  system  shown  in  Figure  2.3  where  the  input 
is  IvJ"  ujj  ,  and  the  output  is  |ef  ejj  .  The  system  in  Figure  2.1  is  internally 
stable  if  and  only  if  the  system  in  Figure  2.3  is  internally  stable.  Finally,  the  internal 
stability  of  the  system  in  Figure  2.3  is  given  by  the  following  theorem. 


Theorem  2.2.3  The  system  in  Figure  2.S  is  internally  stable  iff  (7  —  PyuK)  is 
invertible  and  all  four  transfer  functions  in 


7  -K 

I  +  K(I  -  Py^K)-^Py„ 

K(I-P^K)-' 

-Py,  7 

{I-Py^K)-^Py, 

(2.22) 


which  transfers  the  input 


e,  ,  are  proper  and  stable. 


Proof:  See  [17],  Chapter  4. 


2.S  Operator  Spaces 

The  transfer  functions  in  this  work  can  be  treated  as  elements  of  operator 
(vector)  spaces.  In  particular,  we  will  consider  members  of  the  Hardy  spaces  Hi  and 
Hoat  the  function  space  I/i,  and  the  sequence  space  l^.  The  functions  in  these  spaces 
are  representations  of  the  actual  operators,  but  we  shall  abuse  the  notation  amd  refer 
to  the  functions  as  operators  in  this  work.  For  further  information  on  operators  and 
their  representations,  the  reader  is  referred  to  [18].  This  section  will  define  these 
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spaces,  the  associated  norms,  and  methods  for  computing  the  norms.  First  we  need 
to  define  the  following  Lebesgue  spaces.  L2{—joo,  +joo)  is  defined  as  the  space  of 
all  functions  F(s)  which  are  analytic  on  the  imaginary  axis  and 


F*{ju)F{jw)dw^ 


<  +00 


(2.23) 


Loo(— joo,  +joo)  is  defined  as  the  space  of  all  functions  F(s)  which  are  anzdytic  on 
the  imaginary  axis  and 

ess  sup^[i^(jw)]  <  +00  (2-24) 

weK 

where  a(’)  denotes  the  maximum  singular  value. 


2.3.1  Hi  Space.  Hi  is  defined  as  the  space  of  all  transfer  function  matrices 
which  are  analytic  in  the  open  right-half  complex  plane  and  have  a  bounded  two- 
norm,  where 

IIIWIII  :=  ~  tr  ^  (2-25) 

Furthermore,  we  shall  define  the  subspace  IkHi  as  the  space  of  real-rational  functions 
(rational  functions  with  real  coefficients)  in  Hi.  Hi  is  a  closed  subspace  of  the  Hilbert 
space  (or  complete  inner  product  space)  Li. 
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Unforttmately,  (2.25)  is  not  easy  to  compute,  but  there  is  a  fairly  standard 
method  for  finding  the  two-norm  of  a  transfer  function  (see,  for  example,  [19]). 
Consider  the  transfer  function 


G(s) 

Then  the  two-norm  is  given  by 


A 

B 

C 

0 

(2.26) 


\\G{s)\\l  =  tr  {LcC^C)  =  tr  [LoBB"^)  (2.27) 


where  Lg  and  Lo  are  the  controllability  and  observability  gramians  of  G(s),  respec¬ 
tively.  The  gramisms  are  the  positive  semidefinitive  solutions  to  the  Lyapunov  equa¬ 
tions 

ALc  +  LcA'^  +  BB^  =  0  (2.28) 

LoA-\-A^L^  +  C^C  =  0  (2.29) 

If  G{s)  6  Sif/j  :=  Si/fj  ©  then  the  transfer  function  G{s)  can  be  written 
as 

G(s)  =  Gi(s)  -j-  G2(^)  (2.30) 

where  Gi(s)  €  SJfTj  and  G2(s)  €  Since  the  :nner  product  (Gi,  G2}  =  0, 


||G(s)||’  =  \\G^{s)\\l  ||G,(.)||*  (2.31) 


The  two-norm  of  63(4)  is 


IIG3II2  =  ||g;(s)||3 


where  03(4)  E  RH3  and  its  two-norm  cem  be  computed  using  (2.27). 


(2.32) 
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2.S.2  Hoo  Space.  The  next  space  of  operators  which  will  be  discussed  is 
Hoo-  ffoa  is  defined  as  the  space  of  transfer  function  matrices  which  are  analytic  and 
bounded  in  the  open  right-half  complex  plane.  Again,  the  subspace  of  real-rational 
Hoo  functions  will  be  denoted  as  ^Hoo  •  Hoo  is  a  closed  subspace  of  the  Banach  space 
(or  complete  normed  linear  space)  Loo-  Furthermore,  Hoo  is  the  space  of  bounded 
operators  which  map  £2(0,  -|-oo)  into  £3(0,  +00);  thus  the  norm  of  interest  is  the 
induced  operator  norm 


\\T^\\  ■■= 


This  norm  will  be  referred  to  as  the  infinity-norm.  The  infinity-norm  can  be  seen 
to  be  the  maximum  possible  gmn  of  the  system;  thus,  to  minimize  the  energy  of 
the  output  due  to  a  unknown  but  deterministic  bounded  energy  input,  one  must 
minimize  the  infinity-norm  of  the  transfer  function.  Another  important  property  of 
the  infinity-norm  is  the  submultipUcative  property  of  induced  operator  norms  [18]; 
given  F,G  E  Hoo  then 

IlFGjjoo  <  Ili^lUIIGjU  (2.37) 

This  property,  which  does  not  hold  for  two-norms,  is  very  important  for  robustness 
problems,  as  was  seen  in  Theorem  1.1.1. 

The  infinity-norm  can  be  determined  by  computing  the  maximum  singular 
value  of  the  transfer  function  over  a  sufficiently  large  range  of  frequencies  and  se¬ 
lecting  the  maximum  value.  However,  this  is  not  always  numerically  practical  since 
some  a  priori  knowledge  of  the  maximum  singular  value  behavior  over  frequency  is 


IIT’zwIlco 

(2.33) 

lU  II 

(2.34) 

tt>#o  Iju^lla 

sup  ||z||2 

(2.35) 

II“I|3<1 

supff[T';„„(ja;)] 

(2.36) 

W 
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needed.  Another  more  precise  approach  is  based  on  the  eigenstructure  of  a  Hamil¬ 
tonian  matrix  associated  with  a  state  space  realization  of  a  proper  stable  transfer 
function  [17].  Consider  the  transfer  function 


G{s) 


A 

B 

C 

D 

Then  the  associated  Hamiltonian  is 


(2.38) 


A  +  BR-^D'^C 

+  DD^)-^C  -{A-\-BR-^D^Cf 


(2.39) 


where  R  ;=  7*/  —  D^D.  The  infinity-norm  of  the  transfer  function  is  the  smallest 
such  that  the  eigenvalues  of  H  on  the  imaginary  axis  (if  any)  have  even  partial 
multiplicities.  Effectively,  this  reduces  to  finding  the  smallest  7  such  that  H  has  no 
eigenvalues  on  the  imaginary  axis.  In  Chapter  VI,  a  refined  method  for  computing 
the  infinity-norm  will  be  developed. 


2.3.S  Li  and  A  Spaces.  The  final  spaces  discussed  in  this  work  are  the 
Li  function  space  and  the  sequence  space.  As  with  the  H2-  and  -norms,  the 
2/1 -norm  will  be  developed  for  continuous- time  systems;  however,  the  2i-norm  will 
be  developed  in  discrete-time.  Furthermore,  we  vnll  only  discuss  scalar  transfer 
functions  (SISO)  in  this  section. 

2.3. 3.1  L\  Space.  Let  2/i(0, -|-oo)  denote  the  space  of  all  causal 
functions  g{t)  such  that 


lll/lli  =  /  W)\dt  <  +00 


(2.40) 
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For  convenience,  we  will  denote  the  space  as  L^.  Associated  with  each  g{t)  G  Li 
there  is  a  Laplace  transform  0{s),  where 


g(s)  :=  g{t)e-*dt 

Jo 

(2.41) 

Let  A  denote  the  space  of  sJl  bounded  linear  operators  on  Li. 

A 

induced  norm  on  A  is  given  by 

Given  Q  G  A,  the 

lini  -  jTiin 

ll»II.A  —  II  II 

r^O  Halloo 

(2.42) 

=  lli^lll 

(2.43) 

r+oo 

=  /  \9{t)\dt 

JO 

(2.44) 

where  r  G  Loo(0,  +oo). 

Since  this  is  an  induced  operator  norm,  the  submultiplicative  property  holds 
and  the  norm  can  be  used  for  robustness  analysis.  Computation  of  the  Li-norm  is  not 
as  convenient  as  the  previous  norms.  Since  we  will  only  consider  stable  systems,  the 
impulse  response  will  be  bounded  below  by  some  epsilon  after  a  fixed  time.  Therefore, 
an  approximation  of  the  Li-norm  can  be  made  through  a  truncated  approximation 
of  the  integral  (2.44). 


2.S.S.2  ti  Space.  Let  li  denote  the  space  of  all  sequences  h  =  {h{k)} 


such  that 


1  =  £  IM*)I  <  +00 

k=0 


(2.45) 


Given  a  sequence  h  ^  ii  we  can  define  the  z- transform 


no  :=  E  M*)c‘ 

k=0 


(2.46) 
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If  a.  is  the  z-tiansform  of  the  pulse  response  h  of  a  linear  system,  then  7f  is  stable  if 
and  only  if  h  €  fi  [20].  Let  foo  denote  the  space  of  all  bounded  sequences  /  =  {/(li)} 
with  a  norm  defined  by 

||/|loo  =  mM|/(fe)l  (2.47) 

Define  A  as  the  space  of  all  stable  functions  and  let  7f  €  .A  be  a  particular 
function  which  maps  r  €  foo  to  m  €  Then  h  £  the  pulse  response  associated 
with  Ti,.  The  induced  operator  norm  of  7f  on  .A  is  given  by 


\mu  ■■=  E  IM*)I  (2-48) 

fc=l 

Thus, 

\\n\U  =  ll^lli  (2.49) 

If  r  is  an  unknown  but  deterministic  bounded  magnitude  input,  and  it  is  desired 
to  minimize  the  worst  case  maximum  magnitude  of  the  output  m,  then  the  /i-norm 
of  the  pulse  response  function  should  be  minimized.  For  convenience,  the  induced 
norm  on  A  will  be  referred  to  as  the  ii-noim  of  the  transfer  function.  The  /x-norm 
is  an  induced  norm;  therefore,  the  submultiplicative  property  holds  and  the  norm 
can  be  used  for  robustness  analysis. 

For  the  SISO  case,  the  /i-norm  can  be  approximated  to  an  a  priori  tolerance 
6  through  the  sum  of  a  truncated  series  [21].  Let  h  be  a  finite  dimension2il  linear, 
time-invariant  system,  zmd  let  7f  be  the  z-transform  of  h  with  a  minimal  realization 


W(z)  = 


’  Ai 

b/ 

Ci 

Da 

The  ^x-norm  of  h  is  given  by 


=  E 

h=o 


(2.50) 

(2.51) 
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This  sum  can  be  rewritten  in  state  space  form  as 


l|fc||i  =  £  \C^AiBj\  +  IB^l 

h=0 


(2.52) 


If  h  is  stable,  approaches  zero  as  k  approaches  infinity;  thus,  (2.52)  can  be  approx¬ 
imated  by  truncating  at  some  integer  N.  Suppose  Aj  has  distinct  roots  ai,  02, . .  ■ ,  a„. 
These  Oj  are  the  poles  of  the  z-transform  H{z)  of  h,  and  since  h  is  stable,  |ai|  <  1 
for  i  =  1, . . . ,  n.  Therefore, 


n^)=t 


where 


then 


tr 

El 

*=o 


=  C4zI-Aa)-^Ba  +  Da 

(2.63) 

(2.64) 

Given  some  e  >  0,  whenever  N  is  such  that 

e(1  ®Tno») 

^hjnax 

(2.55) 

S 

(2.56) 

k=0 


Therefore,  for  the  SISO  case,  the  /i-norm  can  be  approximated  to  any  desired  accu¬ 
racy. 


2.S.S.S  Relationship  Between  Li  andii.  For  a  psirticular  trsutsforma- 
tion  from  the  continuous  domain  to  the  discrete  domain,  an  asymptotic  relationship 
between  the  Xi-norm  and  the  /i-norm  can  be  derived.  The  treinsformation  is  knovm 
SIS  a  forward  rule,  which  results  from  substituting 

s  =  (2.57) 


where  r  is  the  discrete  time  step.  Thus,  given  a  continuous  system 


T„r{s)  = 


A 

B 

C 

D 

(2.58) 


then  the  transformed  system  is 


As 

Be 

I  +  tA 

tB 

Ce 

De 

c 

D 

(2.59) 


The  system  in  (2.59)  will  be  referred  to  as  an  Euler  approximating  system  (EAS) 
for  the  continuous  system  [22]. 

Now  the  relationship  between  continuous  and  discrete  one-norms  is  given  by 
the  following  theorems. 


Theorem  2.3.1  Assume  the  continuoua  system 


X  =  Ax  -1-  Br 

(2.60) 

m  =  Cx  -1-  Dr 

(2.61) 

is  stable.  Then,  given  r  >  0,  the  EAS  system 

Xh+i  =  (/  +  TA)xk  -1-  TBrk 

(2.62) 

mk  =  Cxk  +  Drk 

(2.63) 

is  stable,  and 

l|T.n.||.  <  lir®"!!! 

(2.64) 

Furthermore,  ll^mr||i  monotonically  os  r  — >  0. 

Proof:  See  [22],  Theorems  2  and  3. 
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Thus,  using  the  EAS  transformation,  the  fi-norm  will  always  provide  iui  upper  bound 
on  the  £i-norm  for  a  given  system. 


S.4  Lyapunov  Equations 

As  was  already  seen  in  the  computation  of  the  two-norm,  equations  of  the  form 

A^X  +  XA  +  Z  =  0  (2.65) 

play  an  integral  part  in  modern  control  theory.  This  type  of  equation  is  known  as 
a  Lyapunov  equation.  This  section  will  present  some  key  theorems  on  existence  and 
uniqueness  of  solutions  to  Lyapunov  equations.  First,  a  theorem  on  uniqueness  is 
presented. 

Theorem  2.4.1  If  Z  >  0  and  A  is  stable,  the  Lyapunov  equation  (2.65)  has  a 
unique  solution  and  A*  >  0. 

Proof:  See  [23],  Lemma  12.1  ■ 

The  existence  of  solutions  to  (2.65)  is  related  to  the  stability  of  A  through  the 
following. 

Theorem  2.4.2  Suppose  X  >  0,  Z  >  0,  (y/Z,A)  is  detectable  and  (2.65)  holds. 
Then  A  is  stable.  If{y/Z,A)  is  observable,  then  X  >  0. 

Proof:  See  [23],  Lemma  12.2  ■ 

Theorem  2.4.3  The  Lyapunov  equation  (2.65)  has  a  unique  solution  iff  A  is  stable. 
If  A  is  stable,  then  X  =  0  is  the  unique  solution  to 

A’^X  +  XA  =  0  (2.66) 


Proof:  See  [24],  Theorem  2.1. 
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S.5  Riccati  Equations 

Two  forms  of  the  algebraic  Riccati  equation  (ARE)  which  are  associated  with 
H2  and  Hoo  optimization  will  be  used  in  this  dissertation.  This  section  will  present 
some  existence  and  uniqueness  conditions  for  solutions  to  both  types  of  Riccati  equa¬ 
tions. 


S.5.1  Hi  Type.  The  algebraic  Riccati  equation  associated  with  the  Hj 
problem  is 

A^X  +  XA-  XBR-^  BF'X  -I-  =  0  (2.67) 

where  R  =  >  0.  Given  a  minimsd  realization  (A,  B,  G,  0),  the  following  theorem 

characterizes  the  solution  to  (2.67). 

Theorem  2.5.1  Assume  (A,B)  controllable  and  (C,A)  observable.  Tken  there  exists 
a  real  symmetric  solution  X  to  (2.67)  with  the  property  He  [Ai(A  —  BR~^B^X)^  <  0 
(>  0)  for  all  i.  Moreover,  it  is  unique  and  such  that  X  >  0  (<  0).  Furthermore,  it 
is  the  only  solution  tn  the  set  of  all  positive  (negative)  semidefinite  matrices. 

Proof:  See  [25],  Lemma  4.  ■ 

The  controllability  and  observability  conditions  can  be  relaxed  with  the  fol¬ 
lowing  results. 

Theorem  2.5.2  Assume  (A,B)  is  stabiHzable,  If  (2.67)  has  a  reed  symmetric  so¬ 
lution,  then  it  has  a  maximal  solution  X.^.  such  that  X+  >  X  for  all  X  satisfying 

(2.67) .  Moreover,  He  [Xi{A  -  BR-^B'^X.^.)]  <  0  for  all  i. 

Proof:  See  [26],  Theorem  2.1.  ■ 

Theorem  2.5.3  Assume  (A,B)  is  stabilizable.  Then  the  real  symmetric  solution  to 

(2.67)  exists  and  its  maximal  solution  is  positive  semidefinite.  If  (C,A)  is  detectable, 

then  He  jAi(A  —  <  OforaUi,  and  if  (C, A)  is  observable,  thenX+  >  0. 


2-16 


Proof:  See  [26],  Theorem  2.2. 


These  results  hold  for  the  dual  of  (2.67) 

AX  +  XA^  -  XC^R-^CX  +  BB^  =  0  (2.68) 

with  the  following  substitutions:  A  =  i4^,  B  =  and  C  =  B"^,  and  making  the 
appropriate  substitutions  of  observability  (detectability)  and  controllability  (stabi- 
lizability). 

The  above  theorems  and  their  duals  can  be  used  to  develop  a  set  of  assumptions 
which  wiU  ensure  the  existence  of  symmetric  solutions  to  an  H3  type  Riccati  equation. 
This  will  be  useful  in  the  next  chapter  when  we  develop  a  parametrization  of  all 
controllers. 

S.5.2  Hoo  Type.  The  algebraic  Riccati  equation  of  interest  for  the  Hoo 
constraint  in  this  work  is 


AX  +  XA^  +  XBR-^B^X  +  C^C:=0  (2.69) 


Associated  with  the  Riccati  equation  (2.69)  is  the  Hamiltonian  matrix 


M„  = 


A  BR-^B"^ 

CTq 


(2.70) 


Define 

$(s)  :=  R  -  G*(s)G(s) 


G(s)  =  G(sJ  -  A)-^B  (2.71) 


2. 5.2.1  Existence  and  Uniqueness.  If  {A,B)  is  controllable,  then 
the  existence  and  uniqueness  of  the  solutions  to  (2.69)  are  given  by  the  following 
theorem. 

Theorem  2.5.4  Assume  (A,  B)  is  controllable.  Then,  the  following  are  equivalent: 
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t.  there  exiets  a  aohUion  X  of  (2.69)  such  that  X  =  X* 

it.  there  exists  a  solution  X-  of  (2.69)  such  that  9te  [A,(i4  +  BR'^B'^X-)^  <  0 
for  all  j 

•it.  there  exists  a  solution  X+  of  (2.69)  such  that  [A,(A  +  BR'^B'^X^.)^  >  0 
for  all  j 

iv.  the  partial  multiplicities  of  the  imaginary  axis  eigenvalues  of  the  Hamiltonian 
(2.70)  (if  any)  are  even  (the  partial  multiplicity  of  an  eigenvalue  is  defined  as 
the  order  of  its  associated  Jordan  block  when  the  matrix  is  in  Jordan  formj 

v.  >  0  for  alloj  €  (0,  +oo] 

Moreover,  if  i-v  hold,  then  the  following  are  true: 

vi.  the  solution  X.  of  (2.69)  with  the  properties  of  ii  is  unigue 

vii.  the  solution  X+  of  (2.69)  with  the  properties  of  Hi  is  unique 

out.  X-  =  X+  iff  all  the  eigenvalues  of  (2.70)  are  on  the  imaginary  axis 

Proof:  See  [27],  Theorems  1,  3  and  Corollary  5;  [28],  Theorem  3.11;  and  [29], 

Theorem  3.  ■ 

Based  on  this  theorem,  the  existence  of  solutions  to  (2.69)  can  be  determined.  Fur¬ 
thermore,  the  minimal  solution,  which  is  the  one  we  are  most  interested  in,  is  unique. 
The  controllability  assumption  can  be  relaxed  using  the  next  theorem. 

Theorem  2.5.5  Define 

Q{X)  =  AX  +  XA^  -I-  XC'^R-^CX  +  BB"^  (2.72) 

i4ssitine  there  exists  an  X  =  X*  such  that  Q{X)  <  0.  Then 
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t.  if  (A,B)  M  aiahHizable,  there  exists  a  unique  minimal  solution  to  (2.69). 
Furthermore,  X-  <  X  for  all  X  such  that  Q{X)  <  0  and 
tte  [Ai(y4  +  BR'^B'^X-)]  <  0  for  all  i 

a.  if  (-A,B)  is  stahilizable,  there  exists  a  unique  maximal  solution  X.^  to  (2.69). 
Furthermore,  >  X  for  all  X  such  that  Q(X)  <  0  and 
Ste  [A<(>1  +  BR-^B^X+)j  >  0  for  all  i 

Hi.  if  (A,B)  is  controllable,  both  X.^  and  X-  exist.  Furthermore,  X+  >  iff 

He  [Ai(>l  +  BR'^B^X-)]  <  0  for  alii  iff  Re  [A.(^  +  BR-^B'^X+)\  >  0  for  all 

i 

iv.  if  Q(X)  <  0,  then  i  and  ii  above  can  be  strengthened  to 
X.  <  X,  Re  [Ai(yl  +  BR-^B^X.)]  <  0  for  all  i,  and 

>  X,  Re  [Ai(>l  +  BR~^B'^X+)^  >  0  for  all  i,  respectively 

Proof:  See  [28],  Corollary  3.4.  ■ 

Thus,  if  the  assumption  on  (A,  B)  is  relaxed  to  stabilizable,  we  can  still  determine 
if  solutions  to  (2.69)  exist  and  the  uniqueness  of  the  minimal  solution. 

The  next  theorems  are  key  results  which  will  be  used  in  this  work. 

Theorem  2.5.6  Assume  (A,B)  stabilizable  and  Re  [A{(i4)]  <  0  for  all  i.  If  X  =  X* 
satisfies  (2.69),  then  AT  >  0. 

Proof:  See  [30],  Lemma.  ■ 

Theorem  2.5.7  If  (C,A)  is  detectable,  then  there  exists  anX  >0  satisfying  (2.69) 
only  if  A  is  stable. 

Proof:  Since  (C,A)  is  detectable,  Cf^C  >  0,  and  BR~^B'^  >  0.  Then  from 

[23],  Theorem  3.6,  (■\/XBR~'^B'^X  +  C^C,  A)  is  detectable.  Parthermore,  2usume 
a  solution  X  >  0  exists,  then  (2.69)  can  be  treated  as  a  Lyapunov  equation  and 
Theorem  2.4.1  implies  A  is  stable.  ■ 
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Combining  the  above  two  theorems,  we  can  determine  what  conditions  are  necessary 
for  a  positive  semi-definite  solution  to  (2.69)  to  exist.  Further,  the  nature  of  real 
symmetric  solutions  can  be  determined  from  the  stability  of  the  matrix  A. 


2.5.2.S  The  Riccati  Operator  and  Stabilizing  Solutions.  Consider  a 
Hamiltonian  matrix  M  of  order  2n  which  has  no  eigenvalues  on  the  imaginary  axis. 
One  can  then  define  two  n-dimensional  subspaces  <Y-(M)  and  A'.f(M).  is 

the  invariant  subspace  associated  with  the  eigenvalues  of  M  in  the  left-half  complex 
plane  and  is  the  invariant  subspace  associated  with  the  eigenvalues  of  M  in 

the  right-half  complex  plane.  The  matrix  which  is  comprised  of  the  basis  vectors  of 
A'-(M)  can  be  partitioned  as 


—  span 


X, 


(2.73) 


where  X\,X2  €  Xi  is  nonsingular  if  and  only  if  the  two  subspaces 

X-iM)  and 

are  complementary.  In  this  case,  X  :=  XsX^^  and  the  Riccati  operator  is  defined 
as  Ric  :  M  —>  X  oi  X  =  Ri(^M).  The  domain  of  the  Riccati  operator,  denoted 
dom(Ric),  is  defined  by  all  Hamiltonian  matrices  such  that 

i.  M  has  no  eigenvalues  on  the  imaginary  axis 

ii.  the  two  subspaces  in  (2.74)  are  complementary. 


(2.74) 


Theorem  2.5.8  If  Moo  ^  dom{Ric),  where  Moo  is  defined  by  (2.70),  and 
X  =  Ric{Moo),  then 

i.  X  is  symmetric 
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ii.  X  satisfies  (2.69) 

in.  »e  [A,(A  -I-  BR-^B'^X)]  <  0  for  all  j 
Proof:  See  [31],  Lemma  2.1. 


The  Riccati  operator  can  be  extended  to  include  cases  where  the  Hamiltonian 
M  has  eigenvalues  on  the  imaginary  axis.  If  M  has  eigenvalues  on  the  imaginary  eixis, 
then  there  are  at  least  n  eigenvalues  in  the  closed  left-half  plane.  Thus,  there  is  an 
invariant  subspace  <Y-(M)  (not  necessarily  unique)  corresponding  to  n  eigenvalues 
in  the  closed  left-half  plane  with  a  basis  defined  as  in  (2.73)  which  satisfies 


(2.76) 


where  T.  is  any  2n  x  2n  matrix  with  ite  [A{(T,)]  <  0  for  all  t  =  1, . . . ,  2n.  If  <Y-(M) 
satisfies  the  complementary  property  (2.74),  then  X  :=  X2X{^,  if  X  is  symmetric. 
Define  the  extended  Riccati  operator  Ric  :  M  X  with  domain  dom(Ric)  consisting 
of  all  Hamiltonians  which  satisfy  the  following: 


i.  an  X-(M)  exists  such  that  the  two  subspaces  in  (2.74)  aie  complementary 

ii,  the  resulting  X  =  ^  is  symmetric. 

Ric{M)  may  not  always  be  a  function  since  X  may  not  be  unique.  In  this  work, 
whenever  Ric{M)  =  X  is  used,  it  will  be  a  well-defined  and  X  —  Ric{M)  must  be 
unique. 


Theorem  2.5.9  Suppose  Moo  €  dom{Ric)  and  X  =  Ric{Moo)  is  unique.  Then 

i.  X  is  symmetric 

ii.  X  satisfies  (2.69) 

m.  »e  [A,(.4  -h  BR-^B^X)]  <  0  for  all  j 
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When  m  h<u  at  least  one  j  such  that  equality  holds,  X  is  referred  to  as  the  neutrally 
stabilising  solution  to  (2.69). 

Proof:  Modification  of  [31],  Lemma  2.1  using  the  above  discussion.  ■ 


Finally,  to  conclude  the  discussion  of  Riccati  equations,  consider 

G{s) 


A 

B 

C 

D 

(2.76) 


and  the  associated  Hamiltonian 


Moo  = 


~C{I  -  DD'^Y^C  (A  +  BR-^D^CY 


(2.77) 


where  R  —  7*/  —  D'^D.  Then  the  following  theorem  defines  bounds  on  the  infinity- 
norm. 


Theorem  2.5.10  Assume  A  is  stable  and  R  >  0.  Then  the  following  are  equivalent: 
*•  ll^{«)lloo  <  7 

u.  Mao  has  no  imaginary  axis  eigenvalues 
Hi.  Moo  €  dom{Ric) 

iv.  Moo  €  dom{Ric)  and  X  =  Ric{Moo)  >  0  (>  0  t/  (C,A)  is  observable). 
Furthermore,  the  following  are  equivalent: 

*•  l|G(«)|U  <  7 
a.  Moo  €  dom{Ric) 

Hi.  Moo  G  dom{Ric)  andX  =  Ri<^Moo)  >  0  (>  0  if  (C,  A)  is  observable)  is  unique. 
Proof:  Modification  of  [31],  Lemma  2.4  for  general  7.  ■ 
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Thus,  upper  iind  lower  bounds  on  the  infinity-norm  of  a  transfer  function  can  be 
determined  by  varying  7  so  that  the  Hamiltonian  has  eigenvalues  on  and  off  the 
imaginary  axis.  This  will  be  explored  further  when  numerical  solutions  are  discussed. 

All  of  the  above  theorems  hold  for  the  dual  of  (2.69) 

AX  +  XA^  +  XC'^R-^CX  +  BB^  =  0  (2.78) 

by  making  the  substitutions  A  =  B  =  (7^,  C  =  J5^,  and  D  =  and  mak¬ 
ing  the  appropriate  substitutions  of  observability  (detectability)  and  controllability 
(stabilizability).  Furthermore,  the  matrix  G(8)  is  replaced  by  6^(s)  and  R  becomes 
7*/  —  DD^ .  With  these  substitutions,  the  last  theorem  of  this  section  is 

Theorem  2.5.11  Suppose  A  is  stable.  If  there  exists  an  X  =  X^  >  0  satisfying 

AX  -f  XA^  -I-  {XC'^  +  BD^)R-\XC^  +  BD'^f  -f  BB"^  =  0  (2.79) 

where 

R  =  ^^I-  DD"^  >  0  (2.80) 

then 

\\CisI-A)-^B  +  D\\^<'r  (2.81) 

Proof:  Assume  there  exists  an  TC  =  >  0  satisfying  (2.79).  Rewrite  (2.79)  as 

sX-sX-AX-  XA'^  =  (XC'^  -t-  BD^)R-\XC^  +  BD^f  +  BB^  (2.82) 


or 


{si  -  A)X  +  X{-sI  -  A^)  =  {XC^  +  BD'^)R-^{XC'^  -t-  BD'^f  -h  BB'^  (2.83) 
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F 


Premultiply  by  C{al  —  A)  ^  and  postmultiply  by  {—si  —  A^)  to  get 

CX{-sI  -  +  C{sl  -  A)-^XC^  = 

C{al  -  A)-\XC'^  +  BD'^)R-\XC'^  +  BD'^fC{aI  -  A)-^ 

+  C(al  -  A)-^BB^C{aI  -  A)-^  (2.84) 

Define  L{a)  :=  CX{aI  -  A)-^C^,  L*{a)  :=  C{-aI  -  A^)~^XC^, 

G(a)  :=  C(sl  —  A)~^B,  and  P(a)  :=  G(a)D^.  Then  (2.84)  becomes 

L*(a)  +  L(a)  -  L(a)R-^L*(a)  -  L(a)R-^P*(a) 

-P(a)R-^r(a)  -  P{a)R-^  P*{a)  =  G(s)G*(s)  (2.85) 

Since  R  =  R*  >  0  there  exists  an  R}^^  such  that  R~^l^{R}l^y  =  I,  R}I^{R}I^)*  —  R, 
and  the  following  is  true; 

[R}!^  -  i(s)iZ-^/*  -  P{a)R-^l^)  [r>I^  -  L{a)R-^l^  -  P{a)R-^l^y  = 

R  -  L*{a)  -  L{a)  -  P*{a)  -  P{a)  +  L{a)R-H*{s)  +  L{s)R-^P*{a) 

+  P{a)R-^L*{a)  A  P{a)R~^P*{a)  (2.86) 

Thus,  letting  G(s)  =  C{al  —  A)~^B  +  D  and  using  (2.86)  we  can  rewrite  (2.85)  as 
(r}^^  -  i(s)iZ~V2  _  P(«)i2-V3)  (^1/2  _  l{s)R-^I^  -  P{s)R-^  '^Y  = 

-  DD"^  -  DG*  -  G{a)D^  -  G{a)G*{a)  +  -  G(s)G*(s)  (2.87) 
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The  left  term  of  (2.87)  is  Hermitiem  on  the  juf-ajda;  thus,  it  is  positive  semidefinite. 
Therefore 

2'y^I-G{s)G*{B)-{G{a)G*{a)  +  G{s)D‘^  +  DG* +  DD'^)  <  0  (2.88) 

=»  7*7  -  G(s)G*(s)  <  0  (2.89) 

\\G(s)\\^  <  7  (2.90) 


The  above  theorem  allows  us  to  determine  whether  an  Hgo  constraint  is  met  based  on 
the  stability  of  the  A  matrix  and  the  existence  of  a  positive  semi-dehnite  symmetric 
solution  to  the  algebraic  Riccati  equation  (2.79).  This  theorem  will  be  very  useful 
in  setting  up  the  fixed  order  mixed  H2/H00  problem. 

2.6  Convex  Optimization 

This  section  is  an  introduction  into  some  key  concepts  of  convex  programming 
which  will  be  necessary  for  this  work.  For  a  complete  discussion  of  this  topic,  the 
reader  is  referred  to  [32,  33,  34,  35,  36,  37]. 

Let  X  be  a  vector  space,  Xi,  X2  €  X,  and  a  E  (0, 1),  then  a  convex  combination 
of  xi  and  *2  is  axi  +  (1  —  a)xa.  A  set  C  C  X  is  said  to  be  a  convex  set  if  for 
every  21,23  €  C  then  all  convex  combinations  of  21  and  23  are  also  contained  in  C. 
Defining  a  functional  f  :  C  —*  fft,{  is  said  to  be  a  convex  functional  if 

/[a2i  +  (1  -  0)23]  <  af{xi)  +  (1  -  a)/(23)  (2.91) 

for  all  21,23  E  C  and  aU  a  E  (0, 1).  Furthermore,  f  is  said  to  be  a  strictly  convex 
functional  if  strict  inequality  holds  in  (2.91),  whenever  21  ^  23. 
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Suppose  f(x),  gi(x), . . .  ,gm(^)  sxe  functionals  defined  on  some  subset  C  of  a 
vector  space  X.  We  are  interested  in  the  following  program: 

Minimize  /(*)  subject  to 

^  '  gi(^)  <  0  for  all  i  (2.92) 

where  x  E  C  C  X 

The  functional  f{x)  is  called  the  objective,  and  the  functional  inequalities  gi{x)  <  0 
are  called  the  constraints.  A  vector  x  E  C  is  said  to  be  aji  admissible  point  for  V  if 
it  satisfies  all  the  constraints  in  V.  The  set  A  of  all  admissible  points  is  called  the 
admissible  region  for  V.  If  A  is  not  empty,  the  V  is  said  to  be  consistent,  and  if  there 
exists  an  X  €  A  such  that  gi{x)  <  0  for  all  t,  then  V  is  said  to  be  superconsistent.  If 
V  is  &  consistent  program  and  there  exists  an  x*  6  A  such  that  /(x*)  <  /(x)  for  all 
X  €  A,  then  x*  is  a  solution  for  V.  Furthermore,  if  V  is  superconsistent,  then  the 
admissible  region  has  sm  interior  point.  This  is  a  necessary  assumption  for  the  main 
theorem  of  this  section. 

If  the  objective  /(x),  the  constraints  gi{x),  and  the  underlying  set  C  are  all 
convex,  then  V  is  called  a  convex  program.  In  this  case  the  admissible  set  A  will 
always  be  convex.  The  Lagrangian  C  of  the  convex  program  P  is  defined  as 

£(x,  A)  :=  /(x)  +  ^  Aiyi(x)  (2.93) 

i=l 

where  x  E  C,  \:=  [Ai, . . . ,  Am]^  €  5?”,  and  Ai  >  0  for  all  t. 

The  following  theorem  is  the  central  result  of  convex  programming. 

Theorem  2.6.1  (Kuhn-Tucker  Theorem  (Saddle  Point  Form))  Suppose  V 
given  in  (2.92)  is  a  superconsistent  convex  program.  Then  x*  eC  is  a  solution  ofV 
if  and  only  if  there  exists  a  A*  €  92”  such  that: 

i.  Aj  >  0  for  all  j 
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it.  £(x*,A)  <  £(x*,A*)  <  jC(x,A*) 

for  all  ®  G  C  and  all  A  £  Si*”  aitch  that  Aj  >  0  for  all  j 

m.  Xjgj{x*)  =  0  for  all  j 

Proof:  See  [37],  Theorem  5.2.13.  ■ 

The  above  theorem  is  just  one  form  of  the  famous  group  of  related  theorems  called 
Kuhn-Tucker  (KT)  Theorems.  For  the  convex  analysis  in  this  work,  the  saddle 
point  form  will  be  sufficient.  For  additional  forms  of  the  KT  Theorem,  see,  for 
instance,  [34,  36,  37].  The  results  of  Theorem  2.6.1  are  referred  to  as  the  Kuhn- 
Tucker  conditions,  or  just  the  KT  conditions. 

The  next  theorem  deals  with  the  uniqueness  of  the  solution  to  a  convex  pro¬ 
gram. 

Theorem  2.6.2  Suppose  V  is  the  convex  program  given  in  (2.92)  and  x*  E  C  sat~ 
isfies  the  Kuhn-Tucker  conditions.  If  f(x)  is  strictly  convex,  then  x*  is  unique. 

Proof:  See  [35],  Corollary  to  Theorem  9.4.1.  ■ 

2.7  Duality  in  Minimum  Norm  Problems 

The  final  section  of  this  chapter  will  discuss  a  dual  approach  for  solving  mini¬ 
mum  norm  problems.  An  excellent  source  for  this  subject  is  [36]. 

Let  X  be  a  vector  space.  A  functional  /  :  X  3?  is  a  linear  functional  if 

f(axi  +  0Xi)  =  af{xi)  -1-  0f{x2)  (2.94) 

for  all  Xi,X3  E  X  and  for  all  a,y9  E  312.  Further,  f  is  a  bounded  linear  functional  if 
there  is  some  M  Eft  such  that 


|/(x)|  <  Mjjxll 


(2.95) 
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for  all  a;  €  X.  The  infimum  over  all  such  M  is  called  the  norm  of  f  denoted  ||/||.  The 
space  of  all  bounded  linear  functionals  on  X  is  called  the  dual  of  X  zmd  is  denoted 
X*.  Given  sb*  G  X*,  then 

||x*||  :=  sup  lx*(*)|  (2.96) 

ll*ll<i 

The  spaces  under  consideration  in  this  work  will  be  H2  and  Z2,  which  are  Hilbert 
spaces,  and  as  such  have  special  properties  which  will  simplify  the  dual  problem. 
Let  X  be  a  Hilbert  space.  Then  the  following  theorem  provides  a  representation  of 
bounded  Unear  functionals  on  X. 

Theorem  2.7.1  Riesz-FVechet.*  Assume  X  is  a  Hilbert  space.  If  f  is  a  bounded 
linear  functional  on  X,  then  there  exists  a  unique  vector  y  £  X  such  that 

f{x)  =  {x,y)  (2.97) 

for  all  X  €  X.  Furthermore, 

ll/ll  =  M  (2.98) 

and  every  y  £  X  determines  a  unique  bounded  linear  functional  in  this  way. 

Proof:  See  [36],  Theorem  5.3.2.  ■ 

Thus,  linear  functionals  on  a  Hilbert  space  can  be  represented  uniquely  by  a  vector 
in  the  space.  For  the  remainder  of  this  work  it  wiU  be  assumed  that  [■]*  is  the  vector 
which  represents  the  actual  dual;  while  this  is  an  abuse  of  notation,  it  will  simpUfy 
the  discussion. 

Another  key  concept  in  duality  theory  is  aUgnment.  A  vector  x*  G  X*  is  said 
to  be  aligned  with  a  vector  x  G  A’  if 

(x,x*)  =  ||xl|lx||  (2.99) 
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Finally,  let  AT  be  a  normed  vector  space.  Then  the  support  functional  of  a  convex 
set  if  C  X  is  defined  on  X*  as 

h(x*)  :=  8up(*,**)  (2.100) 

The  next  theorem  provides  the  main  results  from  duality  theory  for  the  minimum 
norm  problem. 

Theorem  2.7.2  Minimum  Norm  Duality;  Assume  X  is  a  real  normed  vector 
space.  Let  d  >  0  denote  the  distance  from  a  point  xi  G  X  and  some  convex  set 
K  Q  X  having  support  functional  h,  then 

II*  -  *ill  =  [(*1.  **)  -  H**))l  (2.101) 

where  the  maximum  on  the  right  is  achieved  by  some  x^  G  X*.  If  the  infimum  on 
the  left  is  achieved  by  some  xo  €  K,  then  — Xq  is  aligned  with  xq  —  xi. 

Proof:  See  [36],  Theorem  5.13.1.  ■ 

Therefore,  the  iniimal  problem  in  the  primal  space  can  be  trzinsformed  into  a  maximal 
problem  in  the  dual  space.  While  this  may  not  always  provide  a  complete  solution 
to  the  problem,  when  combined  with  the  alignment  condition,  optimal  solutions  can 
often  be  found. 

2.8  Summary 

This  chapter  introduced  state  space  representations  of  linear,  time-invariant 
trr.Tsfer  functions.  Further,  we  introduced  the  concept  of  internal  stability.  Next,  the 
operator  spaces  /fj,  Hoo,  and  Li  and  their  associated  norms  were  introduced.  A  brief 
review  of  Lyapunov  equations  and  H2  type  algebraic  Biccati  equations  was  presented. 
A  more  detailed  review  of  the  conditions  required  for  the  existence  and  uniqueness  of 
solutions  to  Heo  type  algebraic  Riccati  equations  was  presented.  This  was  followed 
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by  &n  introduction  to  the  basic  concepts  of  convex  programming  including  the  Kuhn- 
Tucker  Theorem.  Finally,  duality  concepts  were  used  to  convert  an  infimal  distance 
problem  into  a  maximal  problem  in  the  dual  space. 
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III.  Review  of  Hqo,  and  /i 


As  was  discussed  in  Chapter  I,  this  dissertation  will  deal  with  H2,  Hoo,  und  fi 
optimization.  This  chapter  will  present  an  introduction  to  a  state  space  approach  for 
finding  fixed-order  controllers  which  achieve  the  design  goals  of  the  above  optimal 
control  problems.  First,  the  important  concept  of  the  Youla  parametrization  of  all 
stabilizing  controllers  will  be  introduced. 

S.l  ParameiTizalion  of  All  StabUizing  Controllera 

Consider  the  feedback  system  ^ven  in  Figure  3.1  where  K  £  "K,  the  set  of 
all  stabilizing  controllers.  K  is  not  a  convex  set;  thus,  the  tools  of  convex  zmalysis 
can  not  be  applied  directly.  However,  a  parametrization  of  all  stabilizing  controllers 
over  a  convex  set  has  been  developed  from  the  work  of  Youla,  et  al  [38].  A  complete 
discussion  of  the  parametrization  can  be  found  in  [17,  39).  This  will  only  be  an 
introduction  into  the  key  ideas  needed  for  this  work.  First  we  need  to  introduce  the 
idea  of  a  coprime  factorization  of  a  transfer  function. 

S.1.1  Coprime  Factorizations.  Two  function  matrices  F(s),G(s)  £  H^o 
ate  rigiU-coprime  if  they  have  an  equal  number  of  coltunns  and  there  exist  function 


Figure  3.1.  Feedback  system 
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matrices  X,Y  &  Hoo  such  that 


=  XF  +  YG  =  I  (3.1) 

Farther,  F  and  G  are  left-coprime  if  they  have  an  equal  number  of  rows  and  there 
exist  fonction  matrices  X,Y  £  Hoo  such  that 


r 


[f  a] 


X 

Y 


=  FX  +  GY  =  I 


(3.2) 


Let  G  be  a  proper  transfer  function  matrix.  Then  writing  G  =  NM~^  where  N  and  M 
are  right-coprime  is  called  a  righi-coprime  factorization  of  G.  Similarly,  the  factoriza¬ 
tion  G  =  N  where  N  and  M  are  left-coprime  is  called  a  left-coprime  factorization 

of  G.  Finally,  for  each  proper  matrix  G,  there  exist  NyM,N ,M^X,Y,X^Y  £  Hoo 
such  that 


G  =  NM~^  =  M-^N 


(3.3) 


and 


\  X  -y' 

M  Y 

1 

N  X 

=  I 


(3.4) 


(3.3)  and  (3.4)  constitute  a  doubly-coprime  factorization  of  G. 


S.1.2  Parametrization.  The  following  presents  a  method  of  parametrizing 
all  stabilizing  controllers  over  all  Q  G  Hoo- 

Theorem  3.1.1  i4ssume  G  is  a  proper  transfer  function  matrix  with  a  doubly- 
coprime  factorization  given  by  (S.S)  and  (3.4).  Then  the  set  of  all  controllers  K 


3-2 


which  staiihze  G  is  parametrized  by 


K  =  (r  -  MQ)(X  -  NQ)-' 

(3.5) 

=  (X-QN)-'{Y-QM) 

(3.6) 

where  Q  G  /Too- 

Proof:  See  [17],  Theorem  4.4.1. 

Recall  that  P  in  Figure  3.1  can  be  partitioned  as 

P  = 

Also,  recall  from  Theorem  2.2.2  that  a  controller  K  stabilizes  P  if  and  only  if  it 
stabilizes  Pyu-  Thus,  we  get  the  following  theorem  which  parametrizes  all  internally 
stable  closed-loop  transfer  functions  T^u,. 

Theorem  3.1.2  Let  N,M^N,M,X^Y,X,Y  G  Hoo  ie  a  doubly-coprime  factoriza¬ 
tion  of  Pyu,  K  he  defined  as  in  Theorem  3.1.1,  and  define 

Tl  =  Ptw  +  PzuMY  Pyu, 

T,  =  P,„M 

Tz  =  MPyw 

Then  Ti,  Tz,  Tz  G  Hoo  ond 

T^  =  Ti-  TzQTz  (3.11) 

Proof:  See  [17],  Theorem  4.5.1.  ■ 


(3.8) 

(3.9) 
(3.10) 


zw  *  zu 


p  p 

z  yu;  .r 


(3.7) 
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S.2  Hi  Optimization 


Hi  optimization  is  a  generalization  of  the  standard  linear  quadratic  Gaussian 
(LQG)  problem.  Returning  to  the  feedback  problem  in  Figure  3.1,  P  can  be  parti¬ 
tioned 

(312) 


such  that 

Z  =  Ptw^  +  Pzu^ 

y  =  PyutW  -I-  PyaU 
The  exogenous  input  w  is  zero-mean  white  Gaussian  noise  with  unit  intensity. 

The  objective  of  Hi  optinodzation  is  to  design  a  controller  K  which  is  stabilizing 
and  minimizes  the  energy,  or  two-norm,  of  the  output  z.  This  can  written  as 


a 


inf 

K(t)Stabilizing 

inf 

K(t)StcMliMng 

inf 

K(z)SteMlixing 


\\Tz.h 

\\Pzu,  +  PzuK{I - 


PyuK)  ^Pywlla 


A  state  space  realization  of  (3.12)  is  given  by 


X 

=  Ax 

+ 

By,W 

+ 

BuU 

z 

=  C,x 

-1- 

Ds^vj 

+ 

y 

=  CyX 

+ 

Dy^W 

DyyU 

The  following  assumptions  are  made: 


i.  =  0 

ii.  Dyu  =  0 

iii.  {A,  Bu)  is  stabilizable  and  (C7y,  A)  is  detectable 


(3.14) 

(3.15) 

(3.16) 


(3.17) 
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iv.  =  /  and  =  1 


V. 


VI. 


A  —  jufi  Bu 

Ct 


has  full  column  tank  for  all  lu 


A  —  jufJ 
C«  Du 


has  full  row  rank  for  all  w 

'y  x.'yui  ^ 

Condition  i  is  required  to  ensure  the  closed-loop  transfer  function  has  a  finite  two- 
norm.  Condition  ii  is  assumed  for  ease  of  development  but  can  be  removed  completely 
through  loop  shifting  techniques  [40].  Condition  iii  is  necessary  for  the  existence  of 
stabilizing  solutions.  Condition  iv  is  a  regularity  condition  which  insures  that  there 
is  a  direct  penalty  on  all  controls  and  no  perfect  measurements.  This  condition 
can  be  relaxed  to  a  rank  condition  through  scaling  [41].  Finally,  conditions  v  amd 
vi  are  required  to  ensure  the  existence  of  stabilizing  solutions  to  the  two  AREs  in 
the  following  solution.  This  condition  is  equivalent  to  requiring  the  Hamiltonians 
associated  with  AREs  be  in  dom(Ric). 

The  controller  which  mininuzes  (3.14)  is  unique  and  will  be  denoted 
with  a  corresponding  minimum  two-norm  gi.  It  is  desired  to  parametrize  sub-optimal 
controllers  for  the  purpose  of  trading  off  Hy  performance  for  Hgo  performance.  All 
stabilizing  controllers  can  be  parametrized  by  a  family  of  lower  fractional  transfor¬ 
mations  (LET)  of  a  transfer  function  J  and  a  constrained  freedom  parameter  Q  £  Hy 
as  shown  in  Figure  3.2.  One  particular  form  of  J  is  given  by 


Juy 

Jur 

Aj 

Kf 

Kn 

J(.)  = 

-K, 

0 

I 

Jyy 

Jvr 

Kd 

/ 

0 

where 

Aj  =  A-KfCy-B^Kc 
K,  =  BlX,  +  D';„C. 


(3.18) 

(3.19) 

(3.20) 

(3.21) 
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Figure  3.2.  system  with  parametrized  controller 


=  YxCl  +  B^Dl, 

(3.22) 

Ka 

=  -C, 

(3.23) 

Kfi 

= 

(3.24) 

and  .^3  and  Yx  are  the  real,  unique,  symmetric  positive  semidehnite  solutions  to  the 
AREs 


{A  -  +  Xx{A  -  B^Dl^C,)  -  X^B^B^Xx  +  CjC,  =  0  (3.25) 

where 

C,  =  {I-D,uDl)C,  (3.26) 

and 

(A  -  B.D^C,)Y,  +  Y,{A  -  -  YiC^C,Y,  +  B^6l  =  0  (3.27) 
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where 


-  Dl^D^)  (3.28) 

The  family  of  controllers  which  produce  ||T,,„||j  <  a  can  now  be  parametrized 
by 

K{,)  =  Ft[Jis),Q{s)]  (3.29) 

where  Q  can  be  chosen  to  be  any  Q  ^  Hi  such  that 

ll«lli  <<»■-«’  (3.30) 


The  optimal  Hi  controller  is  attained  through  the  above  parametrization  when  Q  is 
chosen  to  be  identically  equal  to  zero,  and  the  resulting  optimal  controller  is 


Aj 

Kf 

~Ko 

0 

(3.31) 


3.S  Hgo  Optimization 

Hoo  optimization  was  originated  in  the  seminal  paper  by  Zames  [42].  The 
original  problem  was  posed  in  an  operator-theoretic  framework  as  a  model  matching 
problem  which  can  be  reduced  to  a  Nehari  problem  [17].  A  state  space  solution, 
based  on  a  two  ARE  approach  originally  developed  by  Doyle,  et  al  [11],  will  be 
presented  here. 

Figure  3.3  represents  the  Hgo  feedback  system,  where  d  is  a  bounded  energy 
exogenous  input  Avith  ||d||oo  <  1,  and  the  controlled  output  is  e.  In  general,  the 
symbols  w  and  z  will  be  used  for  Hi  inputs  and  outputs,  and  d  and  e  will  be  used 
for  Hoo  inputs  and  outputs. 
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Figure  3.3.  Hoo  feedback  system 


The  plant  P  can  be  partitioned 


P  = 


Ped  Peu 
Pyd  Pyu 


(3.32) 


such  that 

e  =  Pedd  +  Peu« 
y  =  Pydd  +  PyuU 


(3.33) 


The  Hao  optimization  problem  is  to  design  a  stabilizing  controller  K  which  minimizes 
the  maximum  energy  of  the  output  e,  given  a  bounded  energy  input,  or 


ir  ir 

KMtabUxztng  ||£2||j<X  KMtamitztng 


(3.34) 


^  inf  \\P,i  +  P^K(,I-P„K)-'P^\\„  (3.36) 

Kztabutzmg 


A  state  space  realization  of  (3.32)  is  given  by 

X  =  Ax  +  Bad  +  BuU 

e  =  Cex  +  D,ad  +  (3.36) 

y  =  CyX  +  Dydd  +  DyuU 

The  following  assumptions  are  made: 
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i.  Ded  —  0 


ii.  Dyu  =  0 

iii.  (i4,  J9u)  is  stabilizable  and  {Cy,  A)  is  detectable 


iv.  =  /  and  =  I 


V. 


vi. 


3 

1 

C7e 

3 

1 

Bd 

has  full  column  rank  for  all  u 


has  fuU  row  rank  for  all  u 


[  Cy  Dyd\ 

Conditions  i  and  ii  are  not  required  for  a  solution  to  exist,  but  reduce  the  com¬ 
plexity  of  the  solution.  Condition  iii  is  necessary  for  the  existence  of  stabilizing 
controllers.  Condition  iy  is  a  regularity  condition  which  is  equivalent  to  requiring  a 
direct  penalty  on  all  controls  and  no  perfect  measurements.  The  condition  can  be 
relaxed  to  a  fuU  rank  requirement  through  scaling  [41].  FinaUy,  conditions  v  and 
vi  in  combination  with  iii  guarantee  the  two  Hamiltonian  matrices  corresponding  to 
the  foUowing  solution  axe  in  dom(Ric). 


The  infimum  of  the  norm  in  (3.34)  over  the  set  of  stabilizing  controUers  is 
denoted  2  generiil,  the  controUer  which  achieves  the  inUmum  is  not  unique. 

Furthermore,  2  is  foimd  through  an  iterative  method  based  on  the  solution  to  two 
AREs  and  a  coupling  condition.  This  method  is  based  on  the  parametrization  of  aU 
sub-optimal  controUers  where 

ilrjU  <  7  (3.37) 


for  some  7  >  2-  This  approach  excludes  the  infimum,  but  aUows  it  to  be  approached 
to  any  desired  tolerance.  The  family  of  aU  admissible  controUers  which  satisfy  (3.37) 
is  given  by  the  LFT  (Figure  3.4) 


K{a)  =  Ft[J{B),Q{a)] 


(3.38) 
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Figure  3.4.  Hoo  system  with  parametrized  controller 
The  parametrization  is  defined  by 


where 


(3.39) 


Aj  =  A-KfCy-BuKc  +  'r-^Y^C^{Ce-D^K,)  (3.40) 

Kc  =  {B^X„  +  Dl,Ce){I-r^Y^X^)-^  (3.41) 

Kf  =  Y^C^-\-B,Dl,  (3.42) 

Kci  =  -i'l-^Dy^B'^X„+Cy){I-r^Y^X^)-^  (3.43) 

Kfi  =  r^Y^CjD^  +  B^  (3.44) 
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The  matrices  X^o  and  are  the  solutions  of  the  AREs 


{A  -  +  X^{A  -  B^Dl^C,) 

+Xoo(7''BrffiJ  -  B^Bl)X^  +  aja  =  0  (3.45) 

where 

C,  =  iI-D^Dl)C.  (3.46) 

and 

(A  -  BjD^C,)K.  +  Y^(A  -  BjDl,C,f 

+n.(7'’cfc,  -  cjc,)y„  +  bjbJ  =  o  (3.47) 

where 

Bj  =  Bjil  -  DhDya)  (3.48) 

Finally,  Q  can  be  chosen  to  be  any  Q  €  Hoo  such  that 

llQIloo  <  7  (3.49) 

The  above  parametrization  of  a  controller  K  is  valid  if  and  only  if  the  following 
three  conditions  hold: 

i.  Hx  G  dom{Ric)  with  Xgo  =  R%c{Hx)  >  0 

ii.  Hy  €  dom{Ric)  with  Y^o  =  Ric^Hy)  >  0 

iii.  p{Y^X^)  <  7^ 
where 

A-B^DlC.  ^-^B,Bj-B^Bl] 

-CJ4  ~{A-B^Dl,C.f\ 
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(3.51) 


^  \  A- B„Di,c,  r'‘c:c.  cic, 

''  [  -(.4  - 

are  the  Hamiltonians  associated  with  (3.45)  and  (3.47),  respectively. 

To  find  a  controller  which  results  in  a  closed-loop  infinity-norm  arbitrarily 
close  to  select  an  initial  value  of  7  and  check  the  above  three  conditions.  If  any 
condition  fails,  increase  7  and  repeat  the  process.  If  all  three  conditions  are  met, 
reduce  7  and  repeat  the  process.  In  this  manner,  the  controller  which  minimizes  the 
infinity-norm  csm  be  found  to  any  desired  accuracy  (within  numerical  constraints). 
A  more  refined  method  of  determining  based  on  the  convexity  of  the  AREs  over 
the  set  of  admissible  7  has  been  developed  by  Li  and  the  reader  is  referred  to  [43] 
for  details. 

3.4  The  Complex  Structured  Singular  Value 

The  final  topic  to  be  discussed  in  this  chapter  is  the  structured  singular  value 
p.  This  section  will  introduce  p  and  how  to  find  an  upper  bound  on  p  through  Hoo 
optimization  techniques.  Chapter  VII  will  discuss  the  application  of  (t-synthesis  to 
optimal  control  problems  to  guarantee  robust  stability  and  robust  performance.  For 
a  tutorial  on  the  complex  structured  singular  value,  see  [2]. 

3.4-1  Structured  Singular  Value.  The  structured  singular  value  is  a  matrix 
function  based  on  the  underlying  structure  of  a  set  of  block  diagonal  matrices 

A  :=  {diag[SiIr, , . . . ,  Ai, . . . ,  A^j  |  e  C,  A,-  G  }  (3.52) 

where  Siln  is  the  tth  scalar  block  of  order  and  Aj  is  the  yth  full  block  of  order  mj. 
For  simplicity  of  development,  it  will  be  assumed  that  A  is  square,  but  the  theory 


applies  as  well  for  non-square  perturbations.  The  dimension  n  of  A  €  A  is  given  by 


s  F 

•=1  3=1 


(3.53) 


The  set  of  all  block  diagonal  matrices  which  also  have  an  infinity-norm  bounded  by 
is  defined  by 

BA  :=  {a  G  A  I  ff(A)  <  7"^ }  (3.54) 

The  structured  singular  value  of  a  real  matrix  M  defined  over  the  set  of  perturbations 
A  is 

(3.55) 


'  min  {ff( A)  1  A  e  A,  det(/  -  MA)  =  0  } 
unless  there  is  no  A  G  A  which  makes  I  —  MA  singular,  in  which  case  :=  0. 

From  the  definition  of  it  can  be  seen  that  the  maximum  singulsir 

value  of  M  is  always  an  upper  botind;  however,  this  bound  can  be  conservative. 
One  method  of  reducing  the  conservativeness  of  the  upper  bound  is  to  consider  a 
transformation  which  does  not  affect  the  value  of  ^a(M)  but  does  affect  the  value 
of  a{M).  First  define  a  set  of  scaling  transfer  functions  D  which  has  the  same  block 
diagonal  structure  as  the  perturbations  A.  These  transfer  functions  are  given  by 

^  •  j  ^Sj  >  •  ’  •  >  ^F—l^fnp^i  j  .Imjrj  | 

Di  G  Di  =  D;  >  0,  di  G  »,  dj  >  0}  (3.56) 


Now,  an  improved  upper  bound  is  given  by  the  following: 

Theorem  3.4.1  Assume  M  G  C"’"*,  A  is  defined  by  (S.52),  and  D  is  defined  by 
(3.56).  Then 

Ai(M)  <  (3.57) 

Proof:  See  [44],  Theorem  2.3.3.  ■ 
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Therefore,  we  can  reduce  the  calculation  of  an  upper  bound  on  ft  to  computing  the 
maximum  singular  value  of  a  matrix. 

Consider  the  system  in  Figure  3.5  where  M  and  A  can  be  partitioned  as 


M  = 


Mil  Mia 

Mai  Maa 


A€  A=  ^ 


Ai  0 

0  A, 

The  main  result  from  ft  analysis  follows. 


Ai  E  Ai,  Aa  €  Aa 


(3.58) 


(3.59) 


Theorem  o  i.2  (Main  Loop  Theorem)  The  following  are  equivalent: 


i.  ft^{M)  <  7 
a.  (a)  ft^^{Mn)  <  1,  and 

(^)  [i^r(M,  Aa)]  <  7 

Proof;  See  [2],  Corollary  4.7.  ■ 

The  importance  of  this  theorem  is  that  a  single  test  on  the  transfer  function  M 
allows  us  to  infer  information  about  the  response  to  each  perturbation  block.  Let 
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fiAaiMii)  <  7  be  a  desired  measure  of  performance  and  iiai{M)  <  7  be  a  require¬ 
ment  for  stability.  Then  from  the  Main  Loop  Theorem,  <  7  implies  our 

performance  condition  is  satisfied  and  the  system  is  robustly  stable.  Furthermore, 
by  exchanging  Ai  and  A2  in  the  theorem,  <  7  implies  our  system  has  robust 

performance  for  all  perturbations.  Thus  far  we  have  only  considered  the  case  where 
Af  is  a  constant  matrix.  The  next  section  will  expand  these  concepts  to  include 
matrices  which  vary  over  frequency. 

S.4<S  Frequency  Domain  fi-syntheaia.  Suppose  G(s)  is  a  MIMO  transfer 
function  with  n^  inputs  and  outputs.  Assume  A  C  has  the  block  structure 

given  in  (3.52).  Define  the  set  of  all  dynamic  perturbations  which  have  the  desired 
diagonal  structure  as 

Ad( A)  :=  {A(s)  6  »^oo  I  A(so)  6  A  /or  all  so  6  ^  }  (3.60) 

where  is  the  extended  closed  right-half  complex  plane. 

Now,  the  complex  structured  singular  value  of  a  dynamic  transfer  matrix  G(s) 
over  the  structured  perturbations  A(a)  G  Ad(A)  is  defined  by 

||G(s)1|a  =  sup^A  [G{ju)]  (3.61) 

Notice  that  we  use  the  norm  symbol  for  the  structured  singular  value  of  a  dynamic 
matrix,  but  in  fact,  it  is  not  a  true  norm  since  it  does  not  satisfy  the  triangle 
inequality.  However,  we  will  use  this  notation  for  convenience. 

Define  the  set  D  of  scaling  transfer  functions  which  have  the  same  block  di¬ 
agonal  structure  as  A,  where  each  individual  block  has  the  property  Dj  =  DJ  >  0. 
Then,  an  upper  bound  on  the  structured  singular  value  of  a  transfer  matrix  is  given 
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by 


11G(«)1U  <  sup  inf  W[DMD-')  (3.62) 

„gj|D€D 

=  MJDMD-'U  (3.63) 

Thus,  for  the  purpose  of  control  synthesis,  (3.63)  converts  the  ft  problem  into  an  Hoo 
problem  combined  with  the  selection  of  the  scaling  matrix  D.  The  closed-loop  transfer 
function  M  is  determined  by  some  open-loop  plant  P  and  a  feedback  controller  K. 
The  Haa  problem  can  be  solved  for  any  given  scaling  D  by  solving  a  standard  Hoo 
optimization  problem.  Through  an  iterative  process  of  closing  the  loop  with  an  Hoo 
optimal  controller  K  and  determining  an  optimal  scaling  D,  the  infimum  in  the  above 
problem  can  be  approached.  This  method  is  known  as  D-K  iteration.  The  method 
is  not  guaranteed  to  converge  to  the  optimal  scaling  D,  but  in  practice  provides  an 
acceptable  method  of  approximating  the  optimal  scaling.  This  limitation  is  a  current 
subject  of  research.  The  D-K  iteration  method  results  in  a  controller  order  equal  to 
the  plant  order  plus  twice  the  order  of  the  scaling  transfer  functions.  Furthermore, 
since  /i-synthesis  is  based  on  designing  an  Hoo  controller,  it  can  result  in  a  non-strictly 
proper  controller. 

Computation  of  fi  for  dynamic  systems  is  currently  accomplished  by  computing 
the  D  scaling  over  a  large  range  of  frequencies,  then  finding  a  D(8)  which  matches 
the  resulting  point  by  point  scaling.  The  order  of  D(s)  is  chosen  to  give  the  best 
match,  but  a  trade-off  must  be  made  since  the  order  of  the  resulting  Hoo  controller 
which  minimizes  the  upper  bound  in  (3.63)  is  equal  to  the  order  of  the  original  plant 
plus  twice  the  order  of  D(s)  (in  general,  xninus  one  at  optimal).  Recently,  Safonov 
and  Chiang  have  proposed  a  new  approach  to  /i-synthesis  which  avoids  the  curve 
fitting  problems;  see  [45]  for  details. 
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3.5  Summary 

We  began  this  chapter  by  introducing  the  Youla  parametrization  of  all  stabi¬ 
lizing  controllers.  This  allowed  us  to  parametrize  a  non-convex  set  of  controllers  over 
a  convex  set.  Next  the  solution  to  a  regular  Hi  problem  was  developed.  The  set  of 
controllers  which  result  in  a  closed-loop  transfer  function  with  a  two-norm  less  than 
some  a  priori  value  was  shown  to  be  an  LFT  of  a  particular  matrix  and  a  convex 
set  in  Hi.  Similarly,  the  set  of  controllers  which  satisfy  an  Hoo  constraint  on  the 
closed-loop  transfer  function  was  shown  to  be  an  LFT  of  a  fixed  matrix  and  a  convex 
set  in  Hoo-  The  fixed  matrix  is  based  on  the  solution  of  two  AREs  which  are  cou¬ 
pled.  Finally,  /t-synthesis  wsis  introduced  for  fixed  and  frequency  varying  matrices. 
A  method  of  computing  an  upper  bound  based  on  an  Hoo  problem,  known  as  D-K 
iteration,  was  introduced.  In  the  next  chapter  we  will  begin  to  explore  the  optimal 
Hi! Hoo  problem. 


3-17 


IV.  The  Optimal  H2/H00  Controller 

The  mixed  Hz/Hoa  problem  consists  of  an  H2  objective  function  with  an  Hoc 
constraint.  The  /fj  problem  is  formed  by  selecting  the  outputs  for  which  we  wish  to 
minimize  the  energy  due  to  a  set  of  white  Gaussian  noise  inputs.  Weighting  transfer 
functions  are  often  augmented  at  the  output  to  emphasize  certmn  frequency  ranges 
of  the  response  and  to  deemphasize  other  frequency  ranges.  Additionally,  weighting 
transfer  functions  can  be  augmented  at  the  input  to  provide  a  colored  noise.  The  Hgo 
problem  is  set  up  by  selecting  a  second  set  of  outputs  for  which  we  wish  minimize 
the  energy  of  due  to  bounded  energy  inputs.  Again,  weighting  transfer  functions  can 
be  augmented  at  the  input  and  output  to  control  the  frequency  response.  Stable 
weighting  transfer  functions  wiU  be  used  to  avoid  the  addition  of  unstable  modes  to 
the  problem.  For  further  information  on  methods  of  applying  H2  and  Hoo  optimal 
control,  the  reader  is  referred  to  [19,  39]. 

This  chapter  wiU  pose  the  general  mixed  problem  in  an  operator-theoretical 
framework  and  characterize  the  optimal  controUer  using  convex  analysis.  While  a 
complete  analytical  solution  is  not  presented,  the  formulation  of  the  problem  in  this 
framework  provides  considerable  insight  into  the  nature  of  the  solution  and  limits  of 
performeince.  The  chapter  will  first  set  up  the  mixed  optimal  control  problem  as  a 
convex  program  using  the  Youla  parzunetrization.  Using  this  setup,  the  uniqueness 
of  the  optimal  solution  for  the  mixed  problem  with  one  Hoo  constraint  will  be  shown. 
Furthermore,  a  dual  approach  will  be  used  to  chuacterize  the  order  of  the  optimal 
controller  for  a  special  case  of  the  Hoo  constraint. 

4.1  Parametrization  of  the  H2/H00  Controller 

Consider  the  general  control  system  shown  in  Figure  4.1,  where  w  is  a  unit 
intensity  white  Gaussian  noise  input,  d  is  a  bounded  energy  input,  and  z  and  e 
are  controlled  (possibly  fictitious)  outputs.  It  is  assumed  that  there  is  no  a  priori 
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Figure  4.1.  General  mixed  H%jHoa  optimization  problem 

relationship  between  w  and  d  or  z  and  e.  The  measured  output  is  y  and  the  control 
law  is  tt  =  K(8)y. 

The  mixed  H^IHoo  problem  is  to  design  a  controller  K(s)  such  that  the  transfer 
function  from  w  to  z  has  minimum  energy  subject  to  maintaining  the  maximum  gain 
of  the  transfer  function  from  e  to  d  below  some  predetermined  value  7.  The  former 
problem  is  an  Hj  optimization  problem  and  the  constraint  is  an  Hoo  optimization 
problem.  The  full  plzuat  P(s)  is  formed  from  some  underlying  plant  G(s)  augmented 
with  stable  weighting  transfer  functions  on  the  inputs  d  and  w  and  the  outputs  e 
and  z.  The  general  form  of  the  system  is 

e  Ped  Pew  Peu  d 

Z  Pgd  P iw  Peu  ^ 

y  Pyd  Pyw  Pyu 

This  system  can  be  reduced  to  two  separate  problems:  the  H2  problem,  which  is  to 
find  an  internally  stabilizing  controller  K(s)  that  minimizes  ||T2w||2i  where 

Trw  =  Pew  +  PeuK  (/  -  P^K)'^  Pyw  (4.2) 
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and  the  Hoo  problem,  which  is  to  find  an  internally  stabihzing  controller  K(s)  that 
satisfies  ||Tci||oo  ^  7  for  some  7,  where 

T,4  =  Ped  +  PeuK  (/  -  PyuK)~^  Pyd  (4.3) 


To  simplify  the  discussion,  the  following  definitions  are  made: 


7 

a 


7 


7 


« 


a 


« 


inf  \\T,^\ 

Kadmistible  "  ' 


the  unique  if(s)  that  makes  =  a 

||r«,||«,  when  K{a)  = 

a  solution  to  the  ifa//foo  problem  for  some  7  >  7 
llT,d||oo  when  K(a) 


WTtwh  when  K{8)  =  K„ 


(4.4) 

(4.5) 

(4.6) 

(4.7) 

(4.8) 

(4.9) 
(4.10) 


where  the  admissible  set  of  controllers  is  the  set  of  all  stabilizing  controllers.  Fur¬ 
thermore,  we  will  assume  the  following: 

i.  Ttw  has  a  finite  two-norm  which  implies  P^^,  is  strictly  proper 

ii.  z  cannot  be  decoupled  from  w  which  implies  a  >  0 

iii.  Pzu  ^  0  and  Py„  ^  0 

iv.  and  Pyw  have  full  rank  for  all  «;  €  9? 

The  assumption  i  ensures  is  in  H^.  Assumption  ii  eliminates  the  uninteresting 
case  where  a  controller  can  completely  decouple  the  output  from  the  input.  Assump¬ 
tion  iii  ensures  that  the  is  a  function  of  the  controller  K.  Finally,  assumption 
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iv  is  a  regularity  condition  on  the  problem.  It  ensures  all  controls  have  some 
direct  penalty  and  there  are  no  perfect  measurements. 

To  characterize  the  stabilizability  of  the  individual  problems,  define 


A  := 


ZW  »u 


p  p 

*  yw  *  yu 


:= 


Ped  Peu 
Pyd  Pyu 


(4.11) 


(4.12) 


Lemma  4.1.1  Assume  Pyu  is  aiabilizahle  and  P^,  Poo,  and  P  are  formed  by  aug- 
m  ting  the  plant  G(s)  with  stable  weighting  transfer  functions  at  the  inputs  d  and 
w  and  outputs  e  and  z.  Then  the  following  are  equivalent: 


i.  K  stabilizes  Pyu 
a.  K  stabilizes  Pj 
Hi.  K  stabilizes  Poo 
iv.  K  stabilizes  P 

Proof:  Since  no  unstable  modes  are  introduced  by  augmenting  stable  transfer 

functions  at  the  input  and  output,  Pyu  stabilizable  implies  that  P2,  Poo,  and  P  are 
stabilizable.  Thus,  from  Theorem  2.2.2,  i  implies  ii,  iii,  and  iv.  Conversely,  ii,  iii, 
and  iv  each  imply  i.  ■ 

The  mixed  H2IH00  problem  can  be  stated  as:  find  a  stabilizing  controller  K(s) 
which  minimizes  the  two-norm  of  T^u,  and  satisfies  the  constraint  that  the  infinity- 
norm  of  Ted  is  less  thsm  or  equal  to  some  fixed  7.  This  is  a  mathematical  programming 
problem  with  a  convex  objective  function  and  constraint,  but  the  set  of  all  admissible 
controllers  is  not  convex.  Thus,  convex  programming  cannot  be  directly  applied  to 
solve  the  problem.  However,  through  the  use  of  the  Youla  psiraunetrization  of  all 
stabilizing  controllers,  this  problem  can  be  transformed  into  a  convex  programming 
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problem.  We  begin  by  defining  the  doubly-coprime  factorization  of  Py^, 


Pyu  =  NM-^  =  M-^N  (4.13) 

and 

Y  -X 
-N  M 

Thus,  the  set  of  all  K  which  stabiHze  P^^  is  parametrized  over  Q  £  Hao  by 


M  X 
N  Y 


=  I 


(4.14) 


K  =  {X  +  MQ){Y  +  NQ)-^ 
=  {Y  +  QN)~\X  +  QM) 


Letting  Ko  :=  K{Q  =  0)  =  XY'^  =  Y'^X  and  defining 


Ko  -y-' 
y-i  -Y-'^N 


(4.15) 

(4.16) 

(4.17) 


it  can  be  seen  that  all  stabilizing  K  are  formed  by  a  lower  fractional  transformation 
of  J  and  Q,  Fi{J,  Q),  as  shown  in  Figure  4.2.  Notice  that  the  term  common  to  both 
and  is 

K{I  -  Py^K)-^  =  -{X  +  MQ)M  (4.18) 

Therefore,  we  can  rewrite  equation  (4.2)  as 


=  P^^-P^uXMPyu,-P,uMQMPy^  (4.19) 


—  Ti,  +  T22QT3J 


(4.20) 


where 


Tlj  =  Pg^  —  PxuXM  Py^ 


(4.21) 
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Figure  4.2.  Q-parametrization 


Figure  4.2.  Q-parametrization 
Ta,  =  -P,uM  (4.22) 

Ta,  =  MP^  (4.23) 

Similarly,  we  can  rewrite  (4.3)  as 

Ted  =  P^  -  P^XMPyi  -  P^^MQMPyd  (4.24) 

=  -h  Ta^QTa^  (4.25) 

where 

=  P^-P^XMPyi  (4.26) 

=  -P.uM  (4.27) 

T3«  =  MPyi  (4.28) 
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It  is  possible  to  choose  the  doubly-coprime  factorization  such  that  Ko  is  K2^. ,  thus 


=  0)  =  Ti,  =;►  ri,||2  =  a  (4.29) 


Note  that  it  is  not  necessary  to  pick  this  particular  Kq,  it  is  just  convenient  for  this 
development.  Additionally,  for  the  two-norm  of  Ttw  to  remain  bounded,  Q  must  be 
restricted  to  Q  G  /fj. 

Finally,  the  doubly-coprime  factorization  of  Py^  must  be  found  from  an  712 
order  realization  of  where  n2  is  the  minimal  order  of  P2 — ^in  particular,  from 


A2 

Bui 

II 

a 

flzu 

Cy2 

Dy^ 

“  '  "1 

(4.30) 


or 


Pyu  —  Cy,{sl  —  A2)~^Bu2  +  Dyu 


(4.31) 


Now,  our  problem  can  be  restated  as  the  convex  program:  Find  a  Q  e  H2 
which  satisfies 


a  =  iaf  ||Ti,  +  T2,Q73j||2 

Q€a2 
^  subject  to 

[  l|T.«  +  r,.QT,.|U<7 


(4.32) 


4.2  Uniqueness  of  the  Optimcd  (Order-Free)  H2/H00  Controller 

To  characterize  the  optimal  controller,  we  will  need  the  following  lemma. 


Lemma  4.2.1  G  H2,  then  ||Tzw(Q)||2  is  a  strictly  convex  real  functional  ofQ 

on  H2. 

Proof:  Let  Qi,  Q2  G  H2  and  let  o  G  (0, 1).  Then 


ll^lj  +  ^22  {oiQl  +  (1  ~  <^)Q^  ^32l|2 
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=  ||a7\,  +  aT2,QiT^  +  (1  -  a)Tx,  +  (1  -  a)T2,Q2T2,h  (4.33) 

=  |la[rx,  +  T^QxTaJ  +  (1  -  a)[Ti,  +  (4.34) 

<  allTi,  +  Ta^QxTaJI,  +  (1  -  a)||rx,  +  (4.35) 

where  equality  holds  oidy  if  the  vectors  in  (4.35)  are  cohnear  [46].  However,  this 
impUes 


Ti,  -f  TjjQiTsj 

=  fi(Tit  +  Ti^QiTi^) 

(4.36) 

=»  Ti^QiTi, 

=  -  1)T^,  +  fiTi^QiTi, 

(4.37) 

Qi 

=  +  fiQi 

(4.38) 

but  ^  Hi  [39],  which  implies  Qi  ^  Hi  which  violates  the  assumption; 

thus,  a  contradiction.  Therefore,  the  two-norm  is  a  strictly  convex  functional.  ■ 

Armed  with  the  above  information  we  can  now  show  that  the  optimal  mixed 
controller  is  unique. 

Theorem  4.2.1  Let  7  >  7  ie  given.  Then  the  controller  which  satisfies  the  convex 
program  (4-32)  *s  unique.  Furthermore,  the  following  hold: 

i.  1/7  >  7,  the  resulting  controller  is  the  optimal  Hi  controller 

a.  //2  <  7  ^  7>  7*  =  7  optimal  (i.  e.,  the  solution  will  satisfy  the  ffoo 

constraint  with  equality). 

Proof;  The  problem  is  a  convex  program  with  an  active  convex  constraint.  From 
Lemma  4.2.1,  the  two-norm  is  a  strictly  convex  functional  over  Q,  therefore  from 
Theorem  2.6.2,  there  is  a  unique  Q  E  Hi  which  is  the  optimal  solution  to  the  convex 


program. 


IITedlL 

Figure  4.3.  Admissible  region,  7  >  7 


i.  Define  the  Lagrangian 


iC=||7;«,ll2  +  A(|Moo-7)  (4.39) 

and  assume  the  solution  is  not  on  the  constraint  boundary,  but  falls  somewhere 
in  admissible  region  shown  as  the  shaded  area  in  Figure  4.3  (i.e.,  7*  <  7).  Then, 
&om  Theorem  2.6.1,  A  =  0  and  (4.39)  reduces  to 

r  =  WT^h  (4.40) 

The  unique  controller  which  satisfies  the  conditions  in  Theorem  2.6.1  is 
which  is  in  the  admissible  region;  thus,  it  is  the  solution. 

ii.  Let  7  <  7  <  7  and  sissume  7*  <  7.  Again,  using  Theorem  2.6.1,  this  impUes 
A  =  0  and  the  Lagrzingian  (4.39)  reduces  to  (4.40).  As  before,  K2^,  is  the 
o.dy  controller  which  satisfies  the  KT  conditions.  However,  as  can  be  seen  in 
Figure  4.4,  K2^  is  not  in  the  admissible  region  (shaded  area);  thus,  Theorem 
2.6.1  implies  7*  =  7. 
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IIT.JI2 

IIT«,IL 

Figure  4.4.  Admissible  region,  7  <  7 
4.3  Dual  Approach  to  H2/H00 

The  previous  section  showed  the  uniqueness  of  the  optimal  HijHoo  controller 
based  on  a  Lagrange  multiplier  approach.  This  section  will  examine  the  solution  to 
the  mixed  problem  using  a  minimum  norm  approach.  AU  of  the  previous  assumptions 
on  the  system  hold.  In  addition,  for  this  section  only,  the  system  is  assumed  to  be 
a  SISO  mixed  optimal  control  problem.  This  assumption  is  made  to  simplify  the 
notation  and  can  be  removed.  Again,  our  problem  is:  Find  a  controller  K(8)  which 
satisfies  the  following; 

i.  K(s)  is  internally  stabilizing 

ii.  IIT^wlU  is  minimized 

iii.  l|r«i||oo  <  7  where  7  €  (7,7) 

To  investigate  the  solution  to  the  above  problem  define  a  less  restrictive  prob¬ 
lem:  Find  a  controller  K(s)  which  satishes  the  following: 

i.  K(8)  is  internally  stabilizing 
ii-  ll^nelb  is  minimized 
iii.  llQIloo  <  7  where  7  e  (2,7) 
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This  problem  will  be  solved  using  minimum  norm  duality.  Furthermore,  the  problem 
is  related  to  the  mixed  norm  problem  and  gives  some  insight  into  techniques  which 
might  be  applied  to  find  a  solution  to  the  general  problem.  To  date,  however,  the 
full  mixed  problem  has  not  been  solved  through  this  approach. 

To  begin,  the  problem  is  simplified  by  combining  terms  in  (4.20)  to  get 


Txw  —  (4-41) 

where  Ti,  and  Tja,  =  72, T3,  are  determined  from  the  Youla  parametrization  of  the 
controller.  We  can  now  rewrite  the  problem  as:  Find  Q  G  Hoo  such  that 

»=  inf  r.,  +  r,^(?|i,  (4.42) 

IWI|oo<Tr 

Using  an  inne^  'iter  factorization  [17]  we  will  transform  the  problem  to  a  minimum 
distance  from  a  point  (function)  in  Lj  and  convex  set  in  H2.  Let  r23j  =  r23,.T23j^, 
where  is  a  unitary  inner  function  and  723,^  is  a  stable  smd  minimum  phase  outer 
function.  Then, 


lir..  +  t’m.cii.  =  l|T,-4  r..  + 


(4.43) 

(4.44) 


where  R  :=  TjsJ.Ti,,  5  =  and  X  :=  SQ.  Furthermore,  UTltwIla  is  finite  only 

'H  X  £  Hz  which  implies  Q  G  H^. 

Thus,  our  problem  is  to  find  the  minimum  distance  between  a  point,  R,  and 
a  convex  set  in  X3,  where  the  convex  set  is  defined  by  the  continuous  mapping  S  of 
an  infinity-norm  ball  in  Hz.  Our  problem  is  now  to  find  Q  £  Hz  which  achieves 


a=  mf^P-X||2 


(4.45) 
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where  the  set  K  is  defined  as 


K  =  {SQ^H2\Qe  Hi,  ||C?lloo  <  7}  (4.46) 

From  Theorem  2.7.2  we  get 

a=  max  [{R,X*)  -  h{X*)]  (4.47) 

where  X*  G  which  is  the  dual  of  Lj,  (•,  •)  denotes  an  inner  product,  and  h{X*) 
is  the  support  functional  for  the  set  K  defined  by 

h(X*)=  avLp{X,X*)  (4.48) 

The  first  step  in  solving  the  minimum  distztnce  problem  is  to  determine  the 
support  functional  h(X*)  of  the  set  K.  Since  L2  is  a  Hilbert  space,  Xj  =  X$  and 
functionals  can  be  defined  from  Theorem  2.7.1  as  inner  products.  With  some  abuse 
of  notation,  the  support  functional  can  be  written  as 


h(X*)  :=  sup(A-,A'*)  = 
X€K 

1  r+°° 

sup  —  /  X*{jw)X*{jui)du 
x^K  2ir  J-00 

(4.49) 

X€K  2ir  j 

r“lS*(iu;)X*(iu;)ldu; 

'—00 

(4.50) 

(4.51) 

Thus,  (4.51)  is  an  upper  bound  on  the  supremum.  To  determine  if  it  is  actually  the 
desired  supremum,  we  will  develop  a  sequence  rmd  see  if  it  approaxzhes  the  upper 
bound  as  its  index  approaches  infinity.  Let 

=  (4.52) 
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where  Xn  =  SQn  and 


7  «W5*X*)  ifu;G[— n,n] 

C?n={  (4.53) 

0  otherwise 

Then 

(X„,X*)  =  i£(?;(ia.)S-(,a.)A-(ia,)rfu,  (4.54) 

=  i  7  >s«'[S-(3u)X'{ju,)\S-(ju^)X-{ji^)du  (4.55) 

=  ^ /j5-(y«)jr'(ju.)|iu,  (4.56) 

which  approaches  (4.51)  as  n  approaches  infinity.  Thus,  h(A'*)  is  defined  by  (4.51). 
With  this  definition  the  problem  becomes 

“  II  [s  C  S  £2  |S*(7V)X*(yu,)|A,]  (4.58) 

where  Ey  is  defined  as 

Ey  =  {uetSi  1  \R{-juf)\  >  7  |5(-ia;)|}  (4.61) 
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Notice,  (4.60)  Mrill  be  maximized  when  X*  is  colineax  with  (|i?(— ju;)|  —  7|-S'(— j(i;)|); 
therefore,  X*  has  the  form 

0  if  uf  e  E‘ 

X*  =  <  c[|/2(-ju>)| -7|5(-iu;)|]  if  R{-j(j)  >  ^\S{-ju/)\  (4.62) 

-c[|i2(-jtw)| -7|5(-ia;)|l  if  -R(-jtj)  >  ^\S{-ju)\ 

where  c  :=  |||.R(-ic«/)|  —  7|5'(— iti;)||jj  ^  to  make  ||A’*||2  =  1.  Thus,  we  get 

“  =  (4.63) 

/k, 

=  (4-64) 

{2:r  Ji,  I(|fi(-iu-)|  -T|S(-ia.)|)-(|fl(-i<.,)|  -  7|S(-iu.)|)l}- 

Equation  (4.64)  gives  a  method  of  determining  the  optimal  i.wo-tif'rm  of  a 
mixed  control  problem  for  a  given  7.  However,  it  does  not  provide  a  direct  method 
for  determining  the  optimal  controller.  If  the  infimum  in  (4.42)  is  achieved  for  some 
Qo  €  H2,  we  can  use  the  sdignment  condition  in  Theorem  2.7.2  to  determine  the 
unique  Qo-  In  this  case, 

((K  -  Jfo),  jr„*)  =  ||ii  -  X„||,||Jf;||,  (4.65) 

where  Xo  =  SQo.  However,  from  the  definition  of  X*,  it  can  been  seen  that  the 

alignment  condition  will  force  Qq  to  be  a  piecewise  continuous  function.  This  im¬ 
plies  that  the  controller  which  minimizes  the  two-norm  of  Tz^i  and  satisfies  the  Hgo 
constraint  will  be  piecewise  continuous  and  not  an  ^H2  function.  However,  it  will 
be  the  limit  of  a  sequence  of  functions  since  H2  is  the  closure  of  92^2. 

The  above  derivation  is  based  on  the  eissumptions  7i^  =  0  and  =  I. 

Relaxing  these  conditions,  we  return  to  the  original  SISO  mixed  H2/H00  problem. 
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This  can  be  written  as:  find  the  Q  ^  which  achieves 


cx.  —  inf  11^12  "i" 

Ill’ll +r2,«<?|U<T " 


(4.66) 


As  before,  use  an  inner-outer  factorization  to  get  Tja,  =  7232- ^232„  = 

Ta3ooi^a3«,„-  Define  R  ;=  S  U  :=  and  V  ;=  -Taa,^- 

Then  (4.65)  becomes 


a=  inf  ||/2-5C?||2 


(4.67) 


Once  again,  this  is  a  minimum  distance  problem  between  a  function  and  a  convex 
set  in  £3.  An  equivalent  problem  in  La  is 


a=  mf^llJi-Xlla 


where 

K:={SQeH2  igeHa,  \\U  +  VQ\\oo<l} 


Applying  Theorem  2.7.2,  the  problem  is  transformed  to 


(4.68) 


(4.69) 


a=  max  [(i2,  X*)  -  h(X*)] 


(4.70) 


The  problem  now  is  to  find  the  support  functioned  A(X*).  This  is  still  an  open 
problem.  It  would  appear  that  this  would  be  a  simple  extension  of  the  previous 
development  since  the  infinity-norm  constraint  is  an  affine  function  of  Q.  However, 
since  the  constraint  is  an  infinity-norm  ball  in  La,  the  definition  of  the  support 
functional  results  in  a  complex  inner  product.  Further  investigation  into  the  problem 
is  necessary  to  complete  the  theoretical  approach  for  designing  the  optimal  controller 
for  a  mixed  problem. 
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4-4  Summary 

In  this  chapter  the  mixed  H2IH00  optimal  control  problem  was  set  up  and 
parametrized  over  a  convex  set  Q  ^  Using  this  parametrization  we  were  able 
to  show  that  the  optimal  controller  for  a  given  7  is  unique.  The  optimal  solution 
was  shown  to  be  if  7  >  7.  Furthermore,  the  optimal  solution  must  satisfy  the 
Hoo  constraint  with  equality  if  7  <  7  <  7.  Finally,  for  the  SISO  mixed  problem, 
the  special  case  =  0  2ind  =  I  was  investigated  using  a  dual  minimum 

norm  approach.  It  was  shown  that  the  optimal  controller  in  this  case  is  piecewise 
continuous  and  cannot  be  represented  by  a  rational  function. 

One  must  remember  that  the  optimal  controller  discussed  thus  far  is  bzised 
on  a  free  controller  order;  if  the  order  is  fixed  to  some  arbitrary  value,  the  mixed 
solution  may  not  necessarily  be  able  to  achieve  the  same  two-norm  as  the  optimal 
order  controller.  However,  for  applications,  a  fixed-order  controller  of  low  order  is 
desirable.  The  next  chapter  will  develop  the  necessary  conditions  for  an  optimal 
fixed-order  controller  for  the  mixed  H2/H00  optimization  problem. 
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V.  Fixed- Order  H2/H00  Optimal  Control 

The  previous  chapter  characterized  the  optimal  (order-free)  controller  for  the 
mixed  H2IH00  optimization  problem.  While  the  controller  order  heis  not  been  de¬ 
termined  analytically,  numerical  results  suggest  the  optimal  order  is  larger  tham  the 
order  of  the  full  system  including  all  the  if 2  amd  Hoo  weights.  Wells  and  Ridgely  {47] 
have  conjectured  the  optimal  controUer  order  is  infinite.  This  conjecture  is  based 
partly  on  the  evolution  of  the  loop  shape  of  the  closed-loop  system  as  the  order  is 
increased.  For  control  applications,  infinite  order  controllers  are  impractical.  In  fact, 
it  is  desirable  for  the  controller  order  to  be  as  low  as  possible.  However,  a  trade-off  is 
usually  necessary  between  the  controller  order  and  system  performance  and  robust¬ 
ness.  This  chapter  wiU  develop  the  necessary  conditions  for  an  optimal  fixed-order 
mixed  controller. 

Ridgely,  et  ai  [10],  developed  a  fixed-order  solution  for  the  general  mixed 
HzlH^  problem  with  output  feedback.  However,  their  development  is  based  on 
a  controller  order  equal  to  the  order  of  the  underl}ring  system  augmented  with  both 
the  H2  weightings  and  the  ffoo  weightings.  Maintaining  the  lowest  possible  con¬ 
troller  order  is  an  important  consideration  in  control  synthesis.  Therefore,  the  first 
objective  of  this  development  is  to  allow  the  controller  order  to  be  reduced  to  as  low 
as  that  of  the  system  augmented  with  only  the  H2  weights.  This  objective  has  the 
additional  advantage  of  allowing  complicated  (i.e.,  increased  order)  Hoo  weightings 
to  be  introduced  into  the  problem  without  increasing  the  controller  order  directly. 
The  increased  freedom  in  selecting  Hoo  constraint  weighting.i  allows  a  more  desirable 
final  loop  shape  to  be  used  in  the  model  matching  problem.  However,  there  is  still 
a  penalty  to  be  paid  in  computation  time  for  increased  order  constr2unts,  as  vrill  be 
seen  in  the  next  chapter.  Furthermore,  the  H2  order  solution  may  not  be  capable  of 
achieving  the  desired  model  match,  but  there  is  still  a  trade-off  available  as  the  order 
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is  increased  from  that  of  the  H%  problem  to  that  of  the  system  augmented  with  both 
the  H2  weightings  and  the  Hoo  weightings. 

Another  assumption  in  [10]  is  that  the  constraint  forms  a  regul2ir  Hoo  problem. 
In  the  original  formulation  of  the  Hoo  problem,  Zames  [42]  desired  to  minimize  the 
sensitivity  of  a  closed-loop  system.  However,  this  results  in  a  singular  Hgo  optimiza¬ 
tion  problem  (one  in  which  the  control  usage  is  not  directly  penalized  and/or  perfect 
measurements  are  allowed).  In  general,  this  problem  can  be  treated  sub-optimally  by 
placing  limits  on  the  controls  and/or  by  adding  disturbances  into  the  measurements. 
In  the  recent  literature,  this  problem  has  received  much  attention.  Copeland  and 
Safonov  [48]  take  a  generalized  system  approach  in  which  this  problem  is  solved  by 
perturbing  the  singular  problem  to  a  neighboring  regular  Hoo  problem.  They  showed 
that  the  perturbed  solution  converged  to  the  solution  of  the  singu.lar  problem  as  the 
perturbation  approached  zero.  Stoorvogel  [49]  developed  conditions  which  must  ex¬ 
ist  for  the  singular  Hoo  control  problem  with  measurement  feedback  to  be  solvable, 
and  his  solution  is  equivalent  to  the  above  work.  Finally,  Juang,  et  al  [50],  use  the 
structural  sdgorithm  [51]  to  transform  the  singuleir  Hoo  problem  into  a  regular  one. 
However,  all  the  above  techniques  result  in  a  controller  which  is  not  guaranteed  to  be 
proper,  and  in  general,  will  be  improper  for  the  optimal  Hoo  controller.  Therefore, 
the  second  objective  of  this  chapter  is  to  solve  the  mixed  H^/ Hoo  problem  as  formu¬ 
lated  by  [10]  with  the  regularity  assumption  on  the  Hoo  constraint  relaxed.  In  the 
mixed  H2/H00  problem,  the  objective  function  (the  H2  problem)  always  results  in 
a  strictly  proper  controller.  Thus,  appending  singular  Hoo  constraints  will  not  leeid 
to  improper  controllers.  It  should  be  noted  that  this  problem  has  been  addressed  in 
the  literature  by  Juang,  et  al  [50],  but  their  solution  only  provides  an  overbound  to 
the  two-norm. 

Finally,  to  simplify  the  development,  Bidgely,  et  al  [10],  assumed  there  was  no 
feedforw^trd  term  in  the  Hoo  constraint.  However,  this  assumption  restricts  the  Hoo 
constreiint  weightings  to  strictly  proper  transfer  functions.  To  accomplish  this,  the 
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weights  must  be  rolled  off  at  high  frequency.  However,  consider  a  model  matching 
problem  for  the  complementary  sensitivity.  There  is  no  physical  reason  to  roll  off 
the  high  frequency  weight.  In  fact,  it  is  desirable  to  maintain  a  reasonable  weight  at 
high  frequency  to  ensure  unmodeled  high  frequency  modes  are  not  ignored.  Thus, 
the  feedforward  assumption  is  an  unnecessary  restriction  which  limits  the  options 
of  the  designer.  Therefore,  the  final  objective  of  this  chapter  is  to  reformulate  the 
mixed  problem  with  the  feedforward  assumption  on  the  Hoo  problem  in  [10]  relaxed. 
This  will  £dlow  proper  Hoo  weights. 

5.1  State  Space  Formulation 

Consider  the  system  in  Figure  5.1,  where  d  and  w  are  exogenous  inputs  and 
e  and  z  are  the  controlled  outputs.  The  measured  output  is  y  and  u  is  the  control, 
where  the  control  law  is  u  =  Ky.  It  is  assumed,  in  general,  that  there  is  no  re¬ 
lationship  between  e  and  z  or  d  and  w.  The  input  w  is  unit  intensity  zero  mean, 
white-Gaussian  noise  and  the  input  d  is  of  bounded  energy.  The  transfer  function  P 
is  formed  by  augmenting  stable  weighting  transfer  functions  from  an  H2  problem  (w 
to  z)  and  an  Hoo  problem  (d  to  e)  around  the  original  system  C(s),  resulting  in  the 
state  space  form 


where  (•)  are  the  matrices  associated  with  the  system  augmented  by  the  H2  and  Hoo 
weights.  The  order  of  the  individual  H2  and  Hoo  problems  vdll  usually  be  less  than 
that  of  P.  The  state  speice  equations  of  the  individual  H2  and  Hgo  problems  can  be 
written  as 
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Figure  5.1.  General  mixed  HifHoo  optimization  problem 
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(6.6) 


are  the  closed-loop  transfer  functions  from  w  to  z  and  e  to  d,  respectively.  The 
various  matrices  in  (5.4)  and  (5.5)  will  be  defined  shortly. 

To  solve  this  problem,  the  following  assumptions  are  made: 


i-  =  0 


ii.  =  0 


iii.  (i43,  B,^,)  stabilizable,  {Cyj,A2)  detectable 

iv.  full  rank,  full  rank 


V. 


VI. 


A2  —  jul 

Bu3 

c. 

A2  —  jul 

B^  ' 

Cy, 

L- _ 

has  full  column  rank  for  all  ut 


has  full  row  rank  for  all  u; 


Assumptions  i-vi  are  made  for  the  reasons  given  in  Section  3.2  for  an  H2  problem. 
Since  the  H2  problem  is  a  regular  problem,  it  will  guarantee  a  proper  stabilizing 
controller  will  result;  therefore,  the  Boo  assumptions  from  Section  3.3  are  relaxed. 
In  particular,  is  not  restricted  to  zero  and  no  assumptions  are  made  as  to  the 
ranks  of  Deu  and  Dyd-  Furthermore,  no  restriction  is  placed  on  yciz-axis  zeros  of  the 
associated  Hamiltonians.  Therefore,  singular  and  non-strictly  proper  Boo  constraints 
are  allowed  in  this  development. 

The  controller  in  Figure  5.1  is  given  by 


Xc  =  AcXe  -t-  BcV 

u  =  CeXc  -H  DcV  (5.6) 
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Combining  (5.2)  with  (5.6)  produces  the  closed-loop  state  space  equations  for 


x,  =  (A  -I-  DcCy^  )®3  +  But  CcZc  +  (B„  -I-  Bu,  DcDy^  )w 

Xc  =  BcC'yjXj  -f  AcXc  -t-  BcD^w  (5.7) 

z  =  {Ct  + Dt^DcCy^)xi-\- Dty,CcXc-\- DzuDcDy^w 


Notice  that  D^DcD^  must  be  identically  zero  for  the  two-norm  of  r*u,  to  be  finite; 
therefore,  assumption  iv  implies  Dc  =  0.  Thus,  we  can  assume  mthout  loss  of 
generality  that  the  controller  K  is  strictly  proper.  It  should  be  noted  that  the  set  of 
admissible  fixed-order  controllers  may  not  achieve  the  same  minimum  value  of  the 
infinity-norm  of  Ted  ^  fhe  set  of  all  stabilizing  controllers.  Therefore,  2  be 

the  same  as  in  the  optimal  order  case. 

Closing  the  loop  of  our  system  we  get 


xa  =  AjXi  -f  Be,w 

Z  =  C,X2 

Xoo  ~  AocXoc  "t"  Bdd 

e  =  CeXoo  +  Vedd 


where 


Xa  = 


Xa 

*c 


X 


OO 


®oo 

®c 


Aa 


Aa  B^Cc 

BeCyf  Ac 


(5.8) 


(5.9) 


(5.10) 


(5.11) 
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Ax. 


Bh 


C. 

Ce 


Aoo  -Buoo 
BcCyeo  A 


BcDyui 


Bi 

BcDyd 


\c,  fl„C.  ] 

[c,  D„C.] 


(5.12) 

(5.13) 

(5.14) 

(5.15) 

(5.16) 

(5.17) 


5.2  The  Lagrangian  and  Necessary  Conditions 

The  mixed  H2IH00  problem  is  now  to  determine  a  K(b)  such  that: 

i.  Aa  and  Ao  are  stable 
ii-  ||r«i||oo  <  7  for  some  given  7  >  7 
iii>  lITVivlla  is  minimized. 

The  following  theorem  will  be  necessary  for  the  development  of  this  problem. 

Theorem  5.2.1  Let  {Ae,Be,Ce)  he  given  and  assume  there  exists  a  Qoo  =  ^  0 

satisfying 

+  W-CT  +  +  BJifJf  +  B.Bj  =  0  (5.18) 

where  R  =  (7*/  —  VedB^)  >  0.  Then  the  following  are  equivalent: 

*■  (Ao.Hrf)  is  stabilizahle 
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n.  Aoo  is  stable 
in.  Ai  is  stable. 

Moreover,  if  the  above  hold  then  the  following  are  true: 


iv.  ||r.rf||oo  <  7 

0.  the  two-norm  of  the  transfer  function  is  given  by 

\\T.^\\l  =  trie^QsCj]  =  tr[Q,eJC,] 

where  Q2  =  ^  0  m  the  solution  to  the  Lyapunov  equation 

A,Q,  +  QsJl^  +  B„.Bl  =  0 

vi.  all  real  symmetric  solutions  Qoo  of  (5.18)  are  positive  semidefinite 

vU.  there  exists  a  unique  minimal  solution  Qoo  lo  (5.18)  in  the  class  of  real  sym¬ 
metric  solutions 

via.  Qoo  is  the  minimal  solution  of  (5.18)  iff 

i2e[Ai(  A»  +  BsVl^R-^Ce  +  Q„CjR-^C,,)]  <  0  for  all  i 

«.  l|r«,lU  <  (<)  7  ifflfte  [Ai(Ao  +  BsTffiR-^C.  +  Qo.C^R-^C,)]  <  (<)  0  where 
Qoo  is  the  minimal  solution  to  (5.18). 

Proof;  i  ii;  From  the  dual  of  Theorem  2.5.7,  (Aaoi^d)  stabilizable  implies 
.4oo  is  stable,  ii  i:  stable  implies  (A>o>  stabilizable.  ii  iii:  ImpUcation 

comes  directly  from  Lemma  4.1.1  and  the  definition  of  internally  stability.  With  A 
stable,  iv  comes  directly  from  Theorem  2.5.11.  v  is  directly  from  the  discussion  of 
two-norms  in  Section  2.3.1.  vi  is  from  the  dual  of  Theorem  2.5.6.  vii  and  viii  come 
from  the  dual  of  Theorem  2.5.5.  Finally,  ix  follows  from  the  duals  of  Theorems  2.5.5, 
2.5.8,  2.5.9,  and  2.5.10.  ■ 
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The  key  result  of  this  theorem  is  that,  given  a  controller  which  is  closed-loop 
stable  for  the  problem,  we  can  determine  the  minimum  level  of  the  Hoo  constraint 
by  determining  the  minimum  value  of  7  for  which  a  positive  semidefinite  solution  to 
(5.18)  exists. 

Using  Theorem  5.2.1  the  mixed  problem  can  be  restated  as:  Determine  the 
K(s)  which  minimizes 

5c,  a)  =  tr{QiCfC,]  (5.19) 

where  Q3  is  the  real,  symmetric,  positive  semideiinite  solution  to 

A2Q2  -I-  =  0  (5.20) 


and  such  that 

Ax.goo  +  Q<.Al  +  (C?ooCj  -H  BaVQn-^iQ^Cj  -h  BaT^^f  +  =  0  (5.21) 

has  a  real,  symmetric,  positive  semidefinite  solution.  To  solve  this  minimization 
problem  with  two  equality  constraints,  a  Lagrange  multiplier  approach  is  used.  The 
Lagrangian  is 

C  =  tr[Q2CjC,]+tr{[A2Q2  +  Q7Al  +  B„Bl]X} 

+  tr{(A»Qoo  +  QcoAl  +  (QooCj  -j-  BaTl^j)R-^{Q„Cj  +  B^J^f 
+  BaBj]y}  (5.22) 

where  X  and  y  are  symmetric  Lagrange  mtiltiplier  matrices.  This  approach  is  similar 
to  the  one  used  by  Ridgely,  et  al  [10],  but  it  incorporates  the  feedforward  {Dai)  term. 
Furthermore,  Theorem  5.2.1  allows  the  case  where  the  Hoa  constraint  is  singular. 
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The  first  order  necessary  conditions  for  the  minimum  of  this  Lagrangian  are 


dC 

dAc 

dC 

OBc 


dC 

dC, 


dX 

dC 

dQt 

dc 

ay 


dC 


+  y^Qah  +  YiQh  =  0  (5.23) 

+  n^Q<.C7j„ 

+  y^Q'LGl^  +  y^Vo^  +  +  {Y^^Qa  +  y^QDClM 

+  +  Y^Q,)C'^DlM  =  0  (5.24) 

B'^XiQi2  +  B^XiiQi  +  R12Q12  +  R2CeQ2  +  B^YiQab 

+  B^^Yi2Qb  +  R^QaYiQab  +  R^QaYi2Qb  +  R^QabY^Qab 


+  RL>QabY2Qb  +  RbCcQ^YiQab  +  RbCeQbY^Qab 

+  RbCeQ^Yt2Qb  +  RbCeQbY2Qb 

+  PliYiQab  +  Y,2Qb)  +  P2(Y^2Qai>  +  ^Qs)  =  0  (5.25) 

A2Q2  +  Q2AI  +  =  0  (5.26) 

J^X  +  XA2  +  CjC,  =  0  (5.27) 

Ax,<?«,  +  Q^Al  +  {Q^CJ  +  BaB^)R-\QooCj  +  B^V^f 
+  BdBj  =  0  (5.28) 

( Ao  +  BjBf^R-^C,  +  QooCjR-^Cefy 

+  y{A^  +  B^7^R-^C,  +  QooCjR-^C,)  =  0  (5.29) 
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where 


M  =  R-^D,^Dl, 

Pa  =  DlR-^D^Bj 


Pi 


"c 


Qi  Qii 
Qfi  Qi 


Xx 

Xx2 

yt 

■^li 

X2 

Qoo 


Qa  Qab 
Qlb  Qh 


y  = 


y^i  n 


[bi  Di^B-^] 
V^  FxaPj 

PcKii  PcFaPj 


B^Bl  = 


BcDy^ 


(5.30) 

(5.31) 

(5.32) 

(5.33) 

(5.34) 

(5.35) 

(5.36) 


(5.37) 


Bi 

BcDyd 


V;  FofcBj 

BcKS  5cHPJ 


(5.38) 


cr 

CjDl. 


Cx  DxuCc 


Ri  RiiCc 

C!'Rf,  C^RiCc 


'  HI 

_ 1 

r  1 

CjR-^Co  = 

~  e 

R-^ 

Co  DeuCc 

Ra  RabCc 
CjRl  C^RbC. 


(5.39) 


(5.40) 


These  equations  have  not  been  solved  analytically  but  do  provide  some  insight 
into  the  nature  of  the  solution.  In  particular,  (5.29)  implies  that  either  3^  =  0  or 
{Aao  +  BdD^R~^Ce  +  QooCj R~^Ce)  is  neutrally  stable.  The  former  condition  means 
the  solution  is  off  the  boundary  of  the  Hgo  constraint  (where  the  boundary  is  defined 
by  the  constraint  being  satisfied  with  equality),  and  the  latter  condition  implies  the 
solution  lies  on  the  boundary  of  the  Hgo  constraint  and  Qoo  is  the  neutrally  stabilizing 
solution  for  the  Hoo  Riccati  equation  (5.21).  This  relation  will  be  used  to  develop 
the  solution  to  the  problem. 


5.S  H2  Order  or  Greater  Order  Solution 

The  order  of  the  controller  is  now  fixed  to  an  order  greater  than  or  equal  to  the 
order  of  the  underlying  problem,  nj,  and  the  mixed  H^/H^  prjblem  is  solved. 
Since  the  controller  order  is  greater  than  or  equal  to  n2,  the  unique  optimal  solution 
if 3^  is  admissible  and  the  Hoo  constraint  achieves  £in  infinity-norm  of  7  with  this 
controller.  Thus,  for  the  mixed  H2/H00  problem  with  7  >  7  the  optimal  controUer  is 
simply  the  H2  optim2Ll  controller.  Similarly,  no  controller  of  any  order  exists  which 
can  reduce  7  below  the  level  of  the  optimal  Hoo  controller,  7;  therefore,  for  the 
mixed  H2/H00  problem,  no  solution  exists  for  7  <  7.  Finally,  the  two-norm  of  the 
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H2  problem  associated  with  the  optimal  Hoo  controller  is,  in  general,  infinite.  Thus, 
the  only  region  remaining  is  7  <  7  <  7. 

Returning  to  the  last  of  the  first  order  necessary  conditions  (5.29),  the  solution 
to  the  problem  must  either  lie  on  the  boundary,  7*  =  7,  or  it  must  be  off  the 
boundary,  7  <7*  <7-  The  latter  condition  results  in  ^  =  0  and  the  Lagrangian 
(5.22)  reduces  to 

C  =  +  tr{[A2Q2  +  Q2AI  +  (5.41) 

which  is  the  Lagrangian  associated  with  the  H2  optimization  problem.  These  facts 
lead  to  the  following  theorem. 

Theorem  5.3.1  Assume  ric  >  nj.  Then  the  following  hold: 

t.  If'^Kjjno  solution  to  the  mixed  H2/H00  problem  exists 
ii.  If  2  < 'll  that  7*  =  7 

in.  If 'f  >7,  if 3^,  is  the  solution  to  the  mixed  H2/H00  problem. 

Proof: 

i.  Assume  7  <  Then  there  is  no  controller  which  can  satisfy  the  if 00  constraint. 

ii.  Assume  7  <  7  <  7  ajid  7*  <  7.  This  implies  ^  =  0  and  the  Lagrangian  (5.22) 
reduces  to  (5.41).  Prom  Lemma  1  in  [10],  the  only  controller  which  satisfies  the 
first  order  necessary  conditions  for  a  minimum  of  (5.41)  is  the  unique  K2^^. 
However,  this  solution  lies  outside  the  admissible  region;  thus,  a  contradiction. 
Therefore,  7*  =  7. 

iii.  Assume  7  >  7  and  7*  <  7.  Again,  this  implies  y  =  0  and  the  optimal  solution 
is  K2^,  which  is  admissible.  If  7  =  7,  the  Lagrangian  reduces  to  (5.41)  and 
I^2„,t  “  optimal  solution. 


For  a  controller  with  order  greater  than  or  equal  to  the  order  of  the  problem, 
the  solution  to  the  mixed  HijHoo  problem  with  7  <  7  <  7  hes  on  the  boundary 
of  the  Hao  constraint,  7*  =  7.  Moreover,  for  7  <  7  <  7,  Theorem  5.3.1  implies 
there  are  no  extrema  except  those  on  the  boundary  of  the  Hta  constraint.  Thus  in 
this  region,  a*  is  a  monotonicaUy  decreasing  function  of  7  as  shown  in  Figure  5.2. 
Finally,  the  solution  to  the  Riccati  equation  (5.21)  must  be  the  neutrally  stabilizing 
solution.  The  following  theorem  states  this  connection  formally. 

Theorem  5.3.2  Assume  A  is  stable  and  R  =  (7*/  —  DedDj^  >  0.  If  there  exists 
a  Qoo  >  0  satisfying 

+  QcoAl  +  (QooCf  +  BdTfj)R~\Q^Cl  +  Bdifjf  +  =  0  (5.42) 

then  the  following  are  eguivcdent: 

*•  ||3^e<i|loo  =  7 

a.  {Aoa  +  BjTl^jR~^Ce  +  QooCj R~^Ce)  is  neutrally  stable 
Furthermore,  in  titis  case  Qoo  is  unique. 
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Proof:  Tliis  is  directly  &om  Theorems  2.5.9,  2.5.10,  and  2.5.11  and  Theorem  5  in 

[10]. 

5.4  Summary 

This  chapter  developed  the  first  order  necessary  conditions  for  a  fixed-order 
mixed  controller.  The  assumptions  made  in  previous  work  were  relaxed  to  allow 
singular  Hoo  constraints  and  those  vnth  a  feedforward  term.  Further,  the  order  of 
the  controller  can  be  reduced  to  as  low  as  the  H2  order.  Finally,  the  necessary 
conditions  were  used  to  show  that  the  controller  must  satisfy  the  Hoo  constraint 
with  equsdity  whenever  the  construnt  is  active  (and  feasible).  Currently,  there  is 
no  way  of  applying  these  conditions  directly  to  find  analytic  solutions  to  the  mixed 
Hi /Hoo  problem.  In  the  next  chapter  a  numerical  approach,  based  on  the  results  in 
this  chapter,  will  be  developed  for  the  mixed  problem. 
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VI.  Numerical  Approach 

The  previous  two  chapters  characterized  the  optimal  (order-free)  solution  and 
determined  the  necessary  conditions  for  a  fixed-order  solution.  However,  the  de¬ 
velopment  thus  far  has  not  provided  a  technique  for  synthesizing  controllers.  This 
chapter  will  develop  numerical  approaches  to  the  mixed  problem  which  will  approach 
an  optimal  fixed-order  solution.  The  resulting  controller  is  usually  super-optimal,  a 
controller  which  does  not  satisfy  the  constraint  but  is  as  close  as  numerically  possible 
to  the  desired  solution.  Sub-optimal  solutions,  those  which  satisfy  the  constraint, 
but  are  not  optimal,  can  also  be  found  in  many  cases. 

Ridgely,  et  ai  [9],  developed  a  numerical  method  for  synthesizing  solutions 
to  the  general  mixed  H2/H00  optimization  problem.  The  technique  is  based  on  a 
homotopy  method.  A  connection  between  the  Htn  central  controller  (the  controller 
found  by  the  method  in  Section  3.3  with  Q=:0)  and  the  mixed  controller  is  used  to 
develop  a  new  performance  index 

/.  =  (!-  M)||r„||J  + 1,  tTlQ..CTC.]  (6.1) 

where  p  G  (0,  !]•  As  p  is  varied  from  one  to  zero,  the  resulting  controller  approaches 
the  desired  mixed  controller.  For  p  =  1,  the  optimal  controller  is  the  central  Hoo 
controller.  Using  this  as  an  initial  condition,  p  is  decreased  emd  a  new  controller 
is  found  which  minimizes  using  a  Davidon-Fletcher-Powell  (DFP)  method  [37]. 
This  process  is  continued  until  the  two-norm  is  converged. 

There  are  several  drawbacks  to  Ridgely ’s  numerical  solution  to  the  H3/H00 
control  problem.  First,  this  method  requires  a  considerable  amount  of  computation 
time  due  to  a  DFP  search  being  accomplished  for  each  increment  of  the  homotopy 
parameter  p.  Furthermore,  each  run  produces  only  a  single  controller  for  a  fixed  7 
on  the  curve  shown  in  Figure  5.2.  The  computation  time  required  to  find  one  point 
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on  the  curve  is  on  the  order  of  one  week.  Thus,  the  first  objective  of  this  chapter  is 
to  develop  a  numerical  approach  which  reduces  the  computation  time. 

Another  limitation  of  Ridgely’s  approach  is  it  assumes  the  controller  order 
is  equal  to  or  greater  than  the  plant  augmented  with  the  Hi  and  Hoo  weights.  In 
addition,  the  method  assumes  the  Hoo  constraint  is  strictly  proper.  As  was  discussed 
in  the  previous  chapter,  there  are  several  reason  why  these  assumptions  need  to  be 
relaxed.  Therefore,  the  next  two  objectives  are  to  reduce  the  order  of  the  controller 
to  as  low  as  the  Hi  problem  and  to  incorporate  a  feedforward  term  in  the  Hoo 
constraint. 

Finally,  the  greatest  limitation  of  Ridgely’s  method  is  it  is  based  on  the  central 
controller.  Therefore,  it  does  not  allow  singular  Hoo  constraints,  since  the  centred 
controller  may  not  be  strictly  proper  (or  even  proper)  if  the  underlying  Hoo  constraint 
is  singular,  this  poses  a  serious  problem  if  the  Hoo  constraint  is  singular.  As  we  saw  in 
the  last  chapter,  this  places  a  limitation  on  the  designer  if  only  regular  Hoo  constraints 
are  allowed.  Therefore,  the  last  objective  of  this  chapter  will  be  to  develop  a  method 
which  allows  singular  Hoo  constraints. 

Two  numerical  methods  will  be  developed  in  this  chapter — one  will  treat  the 
Hoo  constraint  as  an  equality  constraint  and  the  other  will  treat  it  as  an  inequality 
constraint.  Furthermore,  methods  of  computing  the  gradients  for  the  objectives  and 
constraints  will  be  discussed.  Finally,  an  F-16  longitudinal  control  design  problem 
will  be  used  to  demonstrate  the  numerical  approach. 

6.1  Numerical  Method 

An  alternative  method  for  solving  this  problem  was  motivated  by  Figure  5.2. 
Since  the  optimal  Hi  controller  is  relatively  easy  to  calculate  and  it  provides  a  point 
on  the  desired  curve,  it  was  selected  as  the  initial  controller  for  the  new  method. 
The  problem  now  is  to  start  from  the  optimal  Hi  controller  and  step  along  the  a 
versus  7  curve  by  progressively  reducing  7  from  7  to  7  by  some  increment.  This  is 
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a  new  approach  to  the  mixed  problem  which  has  resulted  in  a  significant  reduction 
in  computation  time.  The  primary  reduction  is  due  to  the  fact  that  each  iteration 
of  the  method  results  in  a  new  point  on  the  a  versus  7  curve.  The  reduction  in 
computation  time  will  be  discussed  further  at  the  end  of  this  chapter. 

6.1.1  Equality  Constraint  Approach.  Applpng  the  results  from  the  previ¬ 
ous  section,  it  is  seen  that  the  optimal  mixed  H2IH00  controller  for  a  fixed  7  will 
have  the  property  that  UTetfUoo  =  7-  This  suggests  an  equality  constraint  approach. 
To  enforce  the  equality  constraint,  the  square  of  the  error  between  the  constraint 
and  its  desired  value  are  adjoined  to  the  objective  function.  While  this  does  not 
guarantee  the  constraint  is  satisfied,  it  will  result  in  a  method  which  attempts  to 
minimize  the  objective  function  while  concurrently  reducing  the  error  in  the  Hgo 
constraint.  This  approach  results  in  the  following  pei.lL>  nance  index 

A  =  IM5  +  ^(lir.dlU--r)’  (6.2) 


where  A  is  a  penalty  on  the  error  between  the  desired  7  and  the  infinity-norm  of  the 
transfer  function.  Define  the  vector  Z  as 


Z  = 


6^  ...  ^ 
Cue  Cl  "Cp  ^Cl 


(6.3) 


where  Uej,  6c,-,  and  Cc,-  are  the  columns  of  Ac,  Be  and  Ce,  respectively.  The  first  order 
necessary  conditions  for  Jy  to  be  a  minimum  are 


dJ.y 

dzi 


9\\T,p,\\l  g  [a  (Moo -7)' 

dZi  dZi 


d\M 

dZi 


■^2A(||T.,|U-7)^ 


=  0 


(6.4) 


for  »  =  1, . . . ,  »*  and  =  nc  x  iic  -!-  nc  x  p  -f-  nc  x  m,  where  Zi  are  the  elements  of  Z. 
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A  DFP  algorithm  [37]  is  used  to  minimize  the  performance  index.  The  one 
dimensional  search  in  the  algorithm  uses  a  parabola  fit  to  reduce  the  number  of 
function  evaluations  required  to  converge  to  the  minimum.  The  DFP  iterations 
are  continued  until  a  predetermined  meiximum  number  of  iterations  (normally,  20) 
is  reached  or  is  below  some  preset  tolerance,  where  VJy  is  gradient 

vector  and  H  is  the  DFP  curvature  matrix.  Further,  if  no  convergence  is  found  by 
the  one  dimensional  search,  the  DFP  routine  is  exited,  the  step  in  7  is  ased,  and 
the  search  is  continued.  This  allows  a  relatively  large  step  size  for  7  .  used.  As 
7  approaches  7,  the  step  size  is  decreased  so  as  to  keep  7  >  7.  The  basic  algorithm 
is  as  follows: 

i.  Compute  the  optimal  H3  controller  and  set  up  the  initial  Z  vector 

ii.  Compute  7  and  set  7  =  7 

iii.  Decrement  7 

iv.  Perform  DPP  search  over  the  Z  vector  space  for  minimum  Jy 

V.  Store  resulting  controller  and  repeat  from  step  iii. 

To  avoid  unstable  closed-loop  systems,  Jy  is  set  to  a  value  of  if  the  closed- 
loop  Aj  matrix  has  any  unstable  eigenvalues.  This  results  in  an  “artificial  wall” 
which  insures  the  algorithm  only  searches  in  the  direction  of  stabilizing  controllers. 

Initially,  the  algorithm  can  be  run  with  loose  tolerances  on  the  DFP  search  to 
define  the  desired  a  versus  7  curve,  then  the  convergence  tolerances  can  be  tightened 
and  a  particular  point  can  be  refined  to  desired  accuracy.  In  addition,  this  new  algo¬ 
rithm  can  be  applied  from  any  initial  condition,  not  just  the  optimal  H3  controller, 
by  substituting  the  appropriate  initial  Z  vector  and  7. 

6.1.S  Ineqtiality  Constraint  Approach.  Unfortunately,  there  are  several 
numerical  drawbacks  to  equality  constraint  approaches  for  numerical  optimization. 
However,  these  can  be  overcome  using  an  inequality  constraint  approach.  Consider 
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the  program 


V 


t 


min 

KttaJbUinng 


f{Z) 


'  subject  to 

,  9(2)  <  0 


(6.6) 


where  f{Z)  =  l|r«„(Z)|(3  and  g(Z)  =  ||7’ej(Z)||oo  — i-  One  approach  to  minimize 
this  performance  index  is  called  sequential  quadratic  programming  (SQP)  [52].  This 
technique  converts  the  nonlinear  program  into  a  quadratic  subproblem  with  a  linear 
constraint.  The  objective  function  is  expanded  in  a  Taylor  Series  around  a  nominzd 
Z  vector.  The  constant  term  is  dropped  and  the  expansion  is  truncated  at  the 
quadratic  term.  The  constraint  is  expanded  in  a  Taylor  Series  and  truncated  after 
the  linear  term.  The  resulting  subproblem  is 


‘  subject  to  (6-6) 

Vg(Zkfd  +  g(Zk)<0 


where  Zk  is  the  value  of  the  Z  vector  at  the  kih.  iteration,  Hk  is  a  positive  definite 
approximation  of  the  Hessian  matrix  and  n,  is  the  length  of  the  Z  vector.  This 
subproblem  can  be  solved  using  available  quadratic  programming  algorithms  [37, 
52,  53]  and  results  in  search  direction  di,  for  the  kih.  iteration.  The  Z  vector  is  then 
updated  by 

Zk+i  =  Zk  +  akdk  (6.7) 

where  ai,  is  determined  from  a  one  dimensional  search.  The  Hessian  matrix  can  be 
updated  in  several  ways,  but  a  common  method  is  the  Broyden-Fletcher-Goldfarb- 
Shanno  (BFGS)  method  [37]  as  follows 


IT  _  IT  I 

■Hfc+l  —  -n*  +  -jf — 


^Hk»k 


(6.8) 
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where  si,  ;=  Zi,+i  —  Zh  and 

qk  :=  V/(Z*+x)  +  AVi7(Z*+i)  -  V f{Zk)XVg{Z,)  (6.9) 

where  A  is  an  estimate  of  the  Lagrange  multiplier.  The  same  algorithm  proposed  in 
the  previous  section  can  be  used,  substituting  the  SQP  minimization  for  the  DFP 
minimization  in  step  iv. 

Another  advsmtage  of  the  SQP  approach  is  it  allows  infeasible  solutions.  This 
allows  the  optimization  routine  to  approach  the  solution  from  both  the  feasible  and 
infeasible  region.  This  has  the  advantage  of  not  forcing  the  routine  to  bias  its  search 
direction  to  ensure  it  remains  in  the  feasible  region.  If  the  SQP  converges  with  a 
stability  constraint  violation,  the  point  will  have  to  reattempted  with  a  smzdler  step 
in  7.  In  general,  this  was  not  found  to  be  a  problem.  For  the  problem  at  hand,  this 
means  we  can  allow  controllers  which  result  in  unstable  closed-loop  systems.  This  is 
done  by  adding  a  second  constraint 

h{Z)  =  m?a{Sle[A<(X2)]}  (6.10) 

This  constraint  is  added  into  the  program  (6.5).  Since  the  closed-loop  system  can  be 
unstable,  a  stable/antistable  projection  of  the  trsmsfer  function  must  be  used  to 
compute  the  two-norm  (see  Section  2.3.1).  A  central  difference  method  can  be  used 
to  compute  the  gradient  of  the  Lagrangian  corresponding  to  the  stability  constraint. 
Analytical  gradients  for  the  stability  constraint  were  not  considered,  but  may  be 
possible. 

6.1.3  Computing  GradierUs  of  the  Two-Norm.  The  gradient  of  the  square 
of  the  two-norm  can  be  computed  using  the  results  of  the  previous  chapter.  Recall 

IIIW.III  =  tr  [QfifC.]  (6.11) 
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where  Q2  is  the  real,  positive  semidefinite  solution  to  the  Lyapunov  equation 


A2Q2  +  Q2J>?  +  B^BI  =  0  (6.12) 

Forming  a  Lagrangian, 

C  =  tr  [QaCjC.]  +  tr  [{A2Q2  +  +  B^Bl)x]  (6.13) 

the  resulting  gradients  are 

(6.14) 

(6.15) 

(6.16) 

(6.17) 

(6.18) 

where  the  various  matrices  are  defined  as  they  were  in  the  previous  chapter.  The 
method  for  actually  computing  the  gradient  VjlTswUi  some  Zk  is  as  follows; 


=  ^12Qi('^  +  ^2Qi2^^  +  ^iaVl2 
=  B^X\Q\2  +  B^X\2Q2  +  RuQii  +  ^jC'cQa 
X  +  XA2-¥  CjCf  =  0 
=  ^jQa  +  Q2A2  +  BwB^  =  0 


i.  Solve  (6.17)  for  X  and  (6.18)  for  Q2 

ii.  Compute  and  ^  from  (6.14),  (6.16),  and  (6.16),  respectively 

iii.  Compute  the  gradient  by 
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6.1.4  Computing  Gradients  of  the  Infinity-Norm.  The  gradient  of  the 
infinity-norm  represents  complex  matrix  relations  and  is  not  easy  to  evaluate  ana¬ 
lytically.  There  are  two  different  approaches  which  have  been  taken  in  this  work. 
The  first  method  uses  a  modified  central  difference  method.  An  improved  approach 
to  computing  the  infinity-norm  of  a  closed-loop  system  is  also  developed  for  use  with 
the  central  differences.  The  second  uses  the  sensitivity  of  the  maximum  singular 
value  of  a  matrix  developed  in  [54]. 

6. 1.4.1  Central  Differences.  The  basic  central  difference  formula  is 

— di —  - 

where 

SZi~^Q...Q  Szi  0-*.o]  (6.21) 

If  the  closed-loop  Am  matrix  of  the  perturbed  system  has  any  unstable  eigenvalues, 
the  infinity-norm  is  set  to  a  value  of  10’°.  This  results  in  an  “artificial  wall”  which 
insures  the  algorithm  only  searches  in  the  direction  of  stabilizing  controllers.  Fur¬ 
thermore,  to  avoid  computing  a  false  partial  derivative  due  to  the  artificial  wall,  a 
one-sided  difference  is  jsed  at  those  points.  If  the  resulting  slope  reduces  Jy  in  the 
direction  of  the  artificial  wall,  the  derivative  is  set  to  zero;  otherwise,  the  one-sided 
difference  is  used. 

As  was  pointed  out  by  Ridgely  [9],  the  computation  of  the  infinity-norm  of  a 
transfer  function  using  the  Hamiltonian  method  is  not  numerically  stable  enough 
for  accurate  numerical  partial  derivatives.  This  is  due  to  the  numerical  ill  condi¬ 
tioning  of  the  Hamiltonian.  However,  Gahinet  [55]  suggests  using  the  generalized 
eigenproblem  to  improve  the  numerical  robustness  of  the  infinity-norm  computation. 
This  can  be  accomplished  by  finding  an  associated  matrix  pencil  which  has  a  similar 
eigenstructure  to  the  original  problem.  Since  the  generalized  eigenproblem  does  not 
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require  an  inversion  of  the  Hamiltonian,  it  is  numerically  better  conditioned.  In 
[55]  Gahinet  develops  such  a  generalized  eigenproblem  by  defining  the  generalized 
Hamiltonian 


A 

0 

0 

B 

0 

0 

C 

0 

7/ 

D 

0 

7/ 

hn 

0 

1 

0  Om+p 


(6.22) 


(6.23) 


where  A  G  B  €  and  C  €  The  generalized  spectrum  of  the 

pencil  H  —  XI  coincides  with  the  spectrum  of  the  Hamiltonian  plus  m  +  p  infinite 
eigenvalues  associated  with  the  singular  part  of  J.  The  QZ  algorithm  [56]  can  be 
used  to  find  the  generalized  spectrum.  To  implement  the  generalized  eigenproblem 
algorithm,  the  lower  bound  on  7  is  set  to  zero.  An  upper  bound  7  =  'Juppcr  is 
selected  and  the  QZ  algorithm  is  used  to  compute  the  generalized  spectrum.  If  the 
real  part  of  any  eigenvalue  is  within  epsilon  of  the  jci;-axis,  then  'jupper  is  increased 
and  the  routine  is  repeated.  Once  an  upper  and  lower  bound  on  the  infinity-norm 
are  found,  a  bisection  method  [57]  is  used  to  refine  the  value.  Since  the  eigenvalues 
of  the  generalized  eigenproblem  are  symmetric  about  the  origin,  they  will  always 
approach  the  jut-ajda  in  pairs  and  separate  along  the  ju-was  in  opposite  directions 
as  7  is  decreased.  To  improve  the  accuracy  of  the  bisection  method,  two  tests  on 
7  axe  used  to  determine  the  yw-axis  intercept:  is  the  real  part  of  the  eigenvalue 
within  some  epsilon  of  the  jw-ajda^  and  is  the  difference  in  the  imaginary  part  of 
the  two  eigenvalues  within  epsilon?  Figure  6.1  graphically  presents  the  region  of  the 
jttf-aada  intercept.  Since  the  eigenvalues  of  the  pencil  H  —  M  are  symmetric  about 
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Re  Axis 


Figure  6.1.  ju;-axis  intercept 

the  real  axis,  one  must  account  for  all  the  eigenvalues  on  the  imaginary  axis.  This 
was  incorporated  into  the  algorithm  by  computing  the  difference  between  all  pairs  of 
eigenvalues  on  the  imaginary  axis  and  then  ensuring  the  sum  of  the  results  is  less  than 
some  epsilon.  This  results  in  a  more  numerically  robust  method  for  determining  the 
axis  intercept.  By  incorporating  both  the  generalized  eigenproblem  approach  and 
the  combined  real  and  imaginary  test,  the  overall  robustness  of  the  infinity-norm 
computation  has  been  improved  enough  to  provide  sufficiently  accurate  numerical 
derivatives  for  a  DFP  algorithm  to  be  used. 

6. 1.4. 2  Singular  Value  Sensitivity.  A  second  approach  for  computing 
the  gradient  value  of  the  infinity-norm  is  based  on  the  sensitivity  of  the  singular  value 
of  a  matrix  developed  by  Giesy  and  Lim  [54].  Assuming  the  maximum  singular  value 
of  Tea  evaluated  at  Z  has  a  single  peak  for  u;  €  the  derivative  of  the  infinity-norm 
can  be  written  as 


(6.24) 
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where  Ui  and  vi  are  the  singular  vectors  associated  with  the  maximum  singular  value 
of  Ted,  <*^0  is  the  frequency  where  the  the  maximum  singular  value  reaches  its  peak 
value,  and  Z^am  is  the  nominal  Z  vector.  The  derivative  of  the  transfer  function  C2m 
be  determined  from 


dTai{wo) 

d  \Ce  —  Ajo)  ^  +  Ved 

dzi 

-  dZi 

(6.25) 


The  advantage  of  this  approach  is  that  it  eliminates  the  bisection  search  re¬ 
quired  in  the  central  difference  approach.  This  can  result  in  a  significant  savings  in 
computation  time  as  the  size  of  the  Z  vector  grows  for  complicated  problems.  In 
addition,  the  accuracy  of  the  gradient  is  better  them  that  of  the  central  difference 
approach.  This  is  due  to  the  fact  that  we  are  not  taking  differences  of  small  numbers 
which  often  results  in  bad  information  due  to  truncation  and  roundoff  errors.  Fur¬ 
thermore,  since  there  is  no  requirement  to  search  for  the  7  which  causes  the  real  part 
of  the  eigenvalues  of  the  Hamiltonian  to  go  to  zero,  the  sensitivity  method  is  better 
posed  numerically.  Finally,  the  gradient  of  the  infinity-norm  of  the  Hoo  constrmnt 
is  often  a  piecewise  continuous  function  of  the  controller  {Z  vector).  This  is  due 
to  the  norm  definition;  it  is  the  peak  magnitude  of  the  function.  As  the  controller 
is  perturbed,  the  firequency  where  the  peeik  magnitude  occurs  can  change  and  the 
gradient  associated  with  the  peak  at  the  new  frequency  is  usually  not  the  same  as 
the  gradient  at  the  previous  peak.  Thus,  a  central  differences  approach  can  result 
in  an  incorrect  gradient.  The  sensitivity  method  does  not  have  this  problem  since  it 
only  provides  information  on  the  unperturbed  transfer  function. 

The  sensitivity  method  does  have  some  disadvantages.  The  first  and  most  often 
encountered  problem  is  when  the  maximum  singular  vrdue  reaches  its  maximum  at 
multiple  frequencies.  As  discussed  above,  this  results  in  a  point  where  the  gradient 
is  discontinuous.  Thus,  the  infinity-norm  is  a  continuous,  but  not  smooth,  function 
of  Z.  Another  limitation  of  the  sensitivity  method  is  it  depends  on  determining 
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the  peak  of  the  majdmum  singular  value  over  frequency.  This  is  accomplished  by 
selecting  a  finite  frequency  range  and  computing  the  maximum  singular  value.  While 
a  priori  knowledge  of  the  behavior  of  can  be  used  to  determine  the  proper 
range  of  frequencies,  there  is  no  guarantee  that  the  range  will  remain  fixed  as  the 
optimization  routine  iterates.  Therefore,  when  using  this  method,  a  check  must 
be  made  to  ensure  the  maximum  actually  occurs  in  the  selected  range.  Finally, 
the  peak  value  of  the  singular  value  is  determined  by  searching  over  a  finite  set  of 
frequencies.  This  set  must  be  fine  enough  to  ensure  an  accurate  peak  is  determined. 
If  the  selected  grid  is  too  coarse,  the  computed  maximum  singular  value  can  be  in 
error.  One  method  to  overcome  this  drawback  is  to  take  a  two-step  approach.  First 
find  the  maximum  singular  value  with  a  coarse  grid,  then  refine  the  grid  and  find 
the  maximum  again.  This  method  was  not  included  in  the  original  code  used  in  this 
work,  but  has  subsequently  been  incorporated. 

Both  of  these  methods  have  been  implemented  for  SISO  and  MIMO  problems. 
To  date,  the  sensitivity  method  has  been  found  to  provide  better  results  than  the 
central  difference  method,  due  to  the  reduced  computation  time  required  and  the 
improved  numerical  accuracy.  AU  the  examples  in  this  work  used  the  SQP  approach. 

ff.J.5  Initial  Conditions  and  Controller  Realizations.  The  two  algorithms 
described  above  use  the  optimal  controller  as  an  initial  condition  for  starting 
the  routines.  This  controller  was  chosen  due  to  its  ease  of  computation;  however, 
the  algorithms  can  be  applied  from  any  initial  controUer,  not  just  the  optimal  H2 
controller,  by  substituting  the  appropriate  initial  Z  vector  and  7.  In  general,  both 
methods  can  result  in  either  sub-optimed  or  super-optimzd  solutions,  depending  on 
the  particular  choice  of  7.  However,  as  the  minimum  infinity-norm  is  approached, 
both  routines  generally  result  in  super-optimeil  solutions  oidy.  This  is  due  to  the 
limitation  of  the  numerical  accuracies  in  the  gradients  described  above.  If  it  is 
imperative  that  a  sub-optimal  solution  be  found,  the  value  of  7  can  be  reduced 
below  the  desired  level  and  the  method  applied. 
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Finally,  the  Z  vector  was  defined  with  a  fully  populated  state  space  form;  by 
using  canonical  forms,  the  number  of  variables  can  be  reduced.  However,  there  are 
drawbacks  to  using  some  canonical  forms  such  as  the  controllability  canonical  form 
due  to  numerical  instability  which  can  result.  The  modal  canonical  form  is  more 
numerically  stable  [58,  59]  and  has  been  used  successfully  to  reduce  the  parameter 
space.  However,  the  drawback  to  this  form  is  it  only  allows  eigenvalues  with  partial 
multiplicities  of  one.  This  has  not  been  a  problem  for  the  controllers  used  in  this 
work,  but  should  be  a  consideration  for  any  future  implementations,  especially  for 
controllers  with  a  large  order  where  repeated  eigenvalues  are  more  likely  to  occur. 
One  approach  to  handle  partial  multiplicities  greater  them  one  is  to  put  the  controller 
into  a  modified  Jordan  Canonical  form  [60].  While  this  adds  a  second  super- diagonal 
of  the  Ac  matrix  to  the  Z  vector,  and  thus  increases  the  size  of  the  parameter  space, 
it  does  account  for  ah  possible  controllers.  Incorporation  of  this  form  should  be 
accomplished  in  follow-on  research. 

6.2  Numerical  Example:  SISO  F-16  Longitudinal  Controller 

An  F-16  longitudinal  controller  design  is  used  to  demonstrate  the  numerical 
method.  The  system  consists  of  a  short  period  approximation  of  a  continuous,  linear, 
time-invariant  normal  acceleration  command  system.  The  pleint  is  augmented  with 
a  first  order  pre-filter  at  the  input  to  model  the  servo  dynamics.  The  filter  is  a 
simplified  model  of  ein  hydraulic  actuator  and  captures  the  lag  inherent  in  such  a 
system.  Additionally,  a  first  order  post-filter  is  augmented  at  the  output  of  the  plant 
to  model  the  control  delay.  This  delay  accounts  for  the  measurement  hold  in  the 
accelerometer. 

The  plant  states  are  the  angle  of  attack  (a)  amd  the  pitch  rate  (g).  The  input 
is  the  stabilator  deflection  (5e)  and  the  output  is  normal  acceleration  (n*).  The 
plant  is  given  in  Appendix  A.  The  objective  is  to  design  a  controller  which  provides 
good  noise  rejection,  state  regulation,  and  minimizes  control  usage  while  concurrently 
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providing  acceptable  tracking  of  a  normal  acceleration  step  input  as  well  as  achieving 
acceptable  vector  gain  and  phase  margins. 

This  problem  is  solved  using  the  mixed  H2/H00  method.  The  H2  portion  will 
minimize  the  effect  of  the  wind  disturbances,  measurement  noise,  and  provide  state 
regulation  and  limit  control  power.  The  Hgo  portion  will  be  used  to  incorporate 
tracking  performance  and  margins. 


6.2.1  H2  Problem.  The  H2  problem  is:  Find  the  internally  stabilizing 
controller  which  minimizes  the  response  of  the  normal  acceleration  and  weighted 
control  due  to  the  wind  disturbance  and  measurement  noise.  The  weight  on  the 
control  is  added  to  ensure  the  control  usage  is  hmited  to  a  realistic  range.  However, 
since  only  the  energy  of  the  control  usage  is  penalized,  unrealistic  peak  deflection 
and  control  rates  can  result  from  the  H2  problem.  To  ensure  that  the  controller 
as  designed  will  work,  a  truth  model  of  the  system  which  includes  magnitude  and 
rate  limiters  must  be  used  to  amalyze  the  closed-loop  system.  However,  the  primary 
purpose  of  this  example  is  to  demonstrate  the  mixed  ffa/^oo  control  design  method, 
and  a  complete  analysis  of  the  resulting  controller  will  not  be  performed. 

This  problem  is  the  standard  LQG  problem.  A  block  diagram  of  the  H2  prob¬ 
lem  is  given  in  Figure  6.2,  where  the  control  weight  is  p  =  10.0  and  the  state 
weighting  matrix  H  is  identical  to  the  system  C  matrix  (i.e.,  we  are  regulating  the 
normal  acceleration  rather  than  the  states).  The  vrind  disturbance  is  modeled  as  a 
white- Gaussian  noise  (WGN)  with  a  strength  of  5.0  x  10~^  rad^-sec  which  enters  the 
system  as  a  pitch  rate  perturbation  resulting  in 
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Figure  6.2.  F-16  H2  block  diagram 


While  feeding  in  the  process  noise  eis  a  pitch  rate  disturbance  is  not  physically 
the  best  approach,  it  done  here  simply  to  provide  an  example  LQG  controller  with 
poor  tracking  and  margins.  The  next  example  in  this  chapter  will  address  the  more 
realistic  problem  with  the  process  noise  modeled  as  an  angle  of  attack  perturbation. 

The  measurement  noise  is  modeled  as  WGN  of  strength  1.6  x  10~®  g*-8ec  and 
Wm  =  1.  The  resulting  H2  matrices  ztre 
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The  resulting  LQG  design  does  a  reasonable  job  of  regulating  the  normal  ac¬ 
celeration  following  an  initial  5°  angle  of  attack  perturbation  as  shown  in  Figure  6.3. 
Also,  response  to  low  and  high  frequency  disturbances  is  minimal.  As  previously 
stated,  this  LQG  problem  was  deliberately  set  up  with  poor  step  tracking.  As  a  re¬ 
sult,  the  system  does  not  track  a  normal  acceleration  unit  step  commsmd,  as  shown 
in  Figure  6.4.  The  control  usage  for  the  initial  perturbation  and  the  unit  step  are 
given  in  Figures  6.5  and  6.6,  respectively.  The  regulator  does  not  demand  too  much 
control  for  these  tasks,  but  Figure  6.6  shows  an  increasing  ramp-up  in  control  which 
may  lead  to  unacceptable  control  demands.  Figure  6.7  presents  the  desired  loop 
shape  at  low  frequency  for  good  tracking  emd  disturbance  rejection  and  at  high  fre¬ 
quency  for  sensor  noise  and  unmodeled  dynamics  rejection.  The  open-loop  GK 
avoids  the  high  frequency  barrier,  but  does  not  clear  the  low  frequency  barrier.  We 
will  use  the  mixed  approach  to  modify  the  controller  to  clear  this  barrier. 

Finally,  the  vector  margins  are  examined  to  determine  how  robustly  stable 
the  system  is  with  the  optimal  H2  controller.  These  margins  represent  the  largest 
independent  variation  in  either  the  gain  or  phase  for  which  the  system  remains  stable. 
For  a  SISO  system,  the  gain  margin  is  the  union  of  the  complementary  sensitivity  gain 
margin  and  the  sensitivity  gain  margin.  However,  for  MIMO  systems,  this  is  not  the 
case;  thus,  in  general,  both  forms  of  the  gain  margins  should  be  presented.  For  more 
information  on  the  vector  margins,  see  [61].  For  this  problem,  [-4.0  6.0]dB  gain 

margin  and  a  phase  margin  of  greater  than  30°  are  desired.  With  the  H2  controller, 
the  complementary  sensitivity  and  sensitivity  gain  margins  are  [—0.473  0.448]  dB 
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Figure  6.3.  F-16,  controller,  response  to  initial  5°  angle  of  attack  perturbation 

and  [—0.473  0.500]  dB,  respectively.  The  phase  margin  is  3.21°.  These  vector 
margins  are  unacceptable.  The  Hgo  portion  of  the  mixed  problem  will  be  used  to 
improve  these  margins. 

6.2.&  Htn  Problem.  The  Hoo  problem  is  a  closed-loop  model  matching 
problem,  as  given  in  Figure  6.8.  A  performance  and  stability  bound  on  the  open- 
loop  transfer  function,  GK,  is  defined;  then  the  desired  closed-loop  sensitivity  is 
derived  as 


S{s)  = 


1 


(6.32) 


1  +  G(s)fC(s) 

Figure  6.7  gives  the  desired  bounds  and  the  desired  open-loop  GK  shape.  The  low 
frequency  bound  is  chosen  to  give  good  noise  rejection  and  step  tracking.  The  high 
frequency  bound  is  set  to  attenuate  system  response  to  high  frequency  sensor  noise 
and  unmodeled  dynamics.  For  a  good  discussion  on  how  to  pick  these  bounds,  see 
[19]  or  [61].  The  desired  open-loop  GK  shape  has  a  crossover  frequency  of  1  rad/sec. 
This  was  selected  as  a  first  cut  to  a  desired  loop-shape;  however,  the  closed-loop 
bandwidth  is  affected  by  the  open-loop  crossover.  The  closed-loop  bandwidth  can  be 
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Figure  6.6.  F-16,  controller,  control  usage  for  unit  normal  acceleration  step 


Figure  6.8.  F-16  Hoo  block  diagram 


increased  by  increasing  the  desired  open-loop  crossover.  To  completely  understand 
the  sensitivity  of  the  resulting  closed-loop  bandwidth  to  the  open-loop  crossover, 
several  open-loop  shapes  should  be  chosen  and  the  control  problem  should  be  re¬ 
peated  for  these  designs.  Since  this  example  is  only  a  demonstration  of  the  mixed 
Hi  I  Hoo  method,  only  one  loop  shape  will  be  used. 

The  Hoo  problem  is  set  up  to  minimize  the  weighted  sensitivity  where 

the  weight  is  the  inverse  of  the  desired  sensitivity,  given  by 


W,= 


s-H.O 
3  +  0.0001 


(6.33) 


The  resulting  Hoo  matrices  are 


-1.491 

0.996 

-0.188 

0 

0 

9.753 

-0.96 

-19.04 

0 

0 

0 

0 

-20.0 

0 

0 

35.264 

-0.334 

-4.366 

-40.0 

0 

-35.264 

0.334 

4.366 

80.0 

-0.0001 

(6.34) 
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It  is  desirable  to  determine  the  minimtun  7  (7)  for  which  the  Hoo  constraint 
can  be  achieved.  Since  the  Hoo  constraint  is  a  singular  Hoo  problem  (Deu  =  0; 
therefore,  there  is  no  direct  penalty  on  the  control  usage),  the  optimal  7  cannot 
be  determined  using  available  methods.  To  overcome  this  limitation,  an  almost 
aingnlar  Hoo  problem  was  solved  by  adding  a  small  perturbation  to  making  the 
problem  a  regular  one.  As  the  perturbation  was  reduced,  the  optimal  infinity-norm 
converged  to  2  =  1-274.  The  feedback-loop  in  the  singular  problem  was  closed  using 
the  controller  resulting  from  the  perturbed  problem.  However,  the  resulting  closed- 
loop  system  was  unstable.  Thus,  the  perturbed  problem  was  only  able  to  give  us  an 
estimate  of  2  for  the  singular  problem.  While  this  does  not  allow  a  direct  comparison 
of  our  results  to  an  Hoo  controller,  it  does  provide  a  known  lower  bound  for  our  Hoo 
constraint. 


6.2.3  Results.  The  initial  controller  for  the  numerical  mixed  solution  is 
the  optimal  Hz  controller.  A  fourth  order  controller  is  designed  to  demonstrate 
the  method  for  controller  order  equal  to  the  Hz  order.  The  SQP  method  is  used 
to  find  the  mixed  Hz  j  Hoo  solutions  as  7  is  reduced  from  7  to  2-  I'l^^  resulting  a 
versus  7  curve  is  given  in  Figures  6.9  and  6.10.  The  points  marked  on  the  curve 
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Table  6.1.  F-16  HtlHoo  Vector  Margins 


a 

7 

Complementary 

Sensitivity 

GM(dB) 

Sensitivity 

GM  (dB) 

PM  (0) 

4th  Order  Controllers 

0.3116 

178375.7400 

[  -0.473 

0.448  ] 

[  -0.473 

0.500  ] 

3.21 

0.3120 

109041.6000 

[  -0.762 

0.701  ] 

[  -0.762 

0.836  ] 

5.26 

0.3139 

59340.3730 

[  -1.352 

1.170  ] 

[  -1.352 

1.602  ] 

9.66 

0.3147 

200.0969 

[  -0.756 

0.696  ] 

[  -0.756 

0.828 } 

5.21 

0.3158 

100.0144 

[  -0.756 

0.696  ] 

[  -0.756 

0.828  ] 

5.21 

0.3175 

50.0256 

[ -1.160 

1.023  ] 

[  -1.159 

1.338  ] 

8.19 

0.3272 

10.0176 

[  -2.488 

1.932  ] 

[  -2.481 

3.486  ] 

19.03 

0.3428 

5.5869 

[  -2.277 

1.803  ] 

[  -2.260 

3.063  ] 

17.09 

0.3493 

3.3604 

[  -3.514 

2.495  } 

[  -3.476 

5.884  ] 

28.49 

0.3567 

2.0091 

[  -5.129 

3.203  ] 

[  -3.937 

7.399  ] 

33.32 

0.3664 

1.7627 

[  -5.376 

3.296  ] 

[  -3.946 

7.434  ] 

33.42 

0.4088 

1.4900 

-5.900 

3.481  ] 

[  -4.588 

10.340  ] 

40.72 

8th  Order  Controller 

0.4500 

1.2808 

[  -6.270 

3.604] 

[  -5.013 

13.186  ] 

45.96 

are  used  to  generate  the  remaining  plots  in  this  section.  It  can  be  seen  that  these 
curves  are  not  monotonicaUy  decreasing;  this  is  due  to  numerical  accuracies.  If  it  is 
desired,  the  curves  can  be  regenerated  with  increased  tolerances  on  the  convergence, 
but  the  additional  computation  time  required  will  not  add  to  this  example  and  thus 
was  not  accomplished.  Table  6.1  gives  the  resulting  two-norms  and  infinity-norms 
of  the  controllers.  Notice  that  the  infinity-norm  can  be  reduced  significantly  with 
little  increase  in  the  two-norm.  This  allows  a  large  increase  in  both  margins  and 
performance  with  little  loss  of  noise  rejection. 

Figures  6.11  and  6.12  show  the  recovery  of  the  desired  sensitivity  shape  and  the 
resulting  complementary  sensitivity  as  7  is  reduced.  Notice  that  the  low  frequency 
sensitivity  is  reduced  as  desired  for  the  performance  bound  while  the  desired  40  dB 
roll-off  is  maintained.  This  can  also  be  seen  in  the  evolution  of  the  open-loop  GK  as 
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Figure  6.11.  F-16,  H3IH00,  nc  =  4,  closed-loop  sensitivity 

7  is  decreased  (Figure  ^.1?).  Further,  the  open-loop  shape  clears  all  the  barriers  at 
the  final  value  of  7. 

The  performance  of  the  system  is  determined  by  its  ability  to  track  a  unit  step 
in  normal  acceleration.  The  performance  improvement  with  decreasing  7  can  be 
seen  in  Figure  6.14.  Moreover,  there  is  little  noticeable  increase  in  noise  in  this  plot 
as  7  is  decreased.  Thus,  substantial  performance  improvement  has  been  made  with 
minimal  loss  of  noise  rejection.  To  compare  the  control  usage  of  the  mixed  controller, 
only  the  system  corresponding  to  the  lowest  7  in  Table  6.1  is  plotted.  Figure  6.15 
shows  the  control  usage  has  increased  for  the  mixed  controller.  Moreover,  the  initial 
control  response  is  2.5  times  greater  than  the  H2  case.  This  is  due  to  the  larger 
system  gain  at  low  frequency  for  the  mixed  controller.  The  increased  control  is  part 
of  the  reason  the  two-norm  increases  as  7  decreases. 

The  system  maintains  good  regulation  with  itll  the  mixed  controllers  as  can  be 
seen  in  Figure  6.16.  This  is  not  surprising  since  all  the  controllers  result  in  sufficient 
low  frequency  gain  for  regulation  performeince.  Again,  Figure  6.17  shows  that  the 
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Figure  6.14.  F-16,  H^/Hoo,  no  =  4,  response  to  a  unit  step  in  normsd  acceleration 
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Figure  6.15.  F-16,  HijHoo,  tIc  =  4,  control  usage  for  a  unit  step  in  normal 

acceleration 


Figure  6.16.  F-16,  Hijllooi  =  4,  response  to  a  5°  initial  angle  of  attack 

perturbation 

system  with  the  lowest  7  has  a  large  initial  control  deflection.  This  is  expected  since 
the  low  frequency  gain  of  the  system  is  large. 

Referring  back  to  Table  6.1,  improvement  in  the  vector  gain  margin  (GM) 
and  pheise  mugins  (PM)  as  7  is  decreased  is  clear.  This  is  another  measure  which 
can  be  used  in  a  trade-off  analysis  to  determine  the  best  7  for  the  desired  system. 
As  7  approaches  7  (1.274),  there  is  a  point  where  the  margins  decrease  as  7  is 
reduced  farther.  The  cause  of  this  fluctuation  is  clearly  seen  in  the  sensitivity  and 
complementary  sensitivity  plots  (Figures  6.11  and  6.12).  As  7  is  decreased  from 
7,  the  majority  of  the  recovery  is  made  at  low  frequency,  and  the  margins  and 
performance  reflect  the  improvement  in  the  loop  shape.  As  7  approaches  7,  the 
metrgins  sometimes  decreeise  as  the  performance  improves.  This  fluctuation  in  the 
margins  is  due  to  the  process  attempting  to  match  the  desired  sensitivity.  As  the 
low  frequency  portion  (performance)  of  the  sensitivity  is  reduced,  it  forces  the  high 
frequency  portion  (margins)  to  increase.  The  resulting  waterbed  effect  drives  the 
margins  up  and  down  as  the  infinity-norm  of  the  weighted  sensitivity  is  reduced. 
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Figure  6.17.  F-16,  ifj/ifoo,  »c  =  4,  control  usage  for  a  5°  initial  angle  of  attack 

perturbation 

Next,  the  controller  order  was  doubled  to  tIc  =  8  and  the  SQP  algorithm  was 
used  to  converge  to  the  lowest  7  possible.  The  last  row  of  Table  6.1  presents  the 
margins  for  this  controller.  The  additional  degrees  of  freedom  have  allowed  the 
margins  to  be  reduced  further  than  was  possible  with  the  fourth  order  controller 
(this  may  also  be  due  to  numerical  difiictdties,  as  will  be  discussed  later).  The 
performance  of  the  controller  is  shown  in  Figure  6.18  and  6.19,  where  the  scale  has 
been  chosen  to  allow  a  direct  comparison  to  the  previous  results.  Regulation  was 
not  significantly  changed  (not  shown).  Notice  that  the  overshoot  is  comparable  to 
the  best  fourth  order  controller,  but  the  settling  time  is  decreased.  The  sensitivity 
of  this  system 's  given  in  Figure  6.20. 

While  the  eighth  order  controller  does  provide  better  margins  and  tracking  than 
any  of  the  fourth  order  controllers,  this  is  at  the  expense  of  doubling  the  controller 
order.  The  design  engineer  must  determine  which  one  of  these  factors  wiU  influence 
his  decision  the  most.  However  for  the  purpose  of  this  example,  the  flexibility  of 
trading  off  controller  order,  noise  rejection,  tracking  performance,  and  vector  margins 
using  the  mixed  H2IH00  approach  has  been  clearly  demonstrated. 
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Figure  6.18. 


Figure  6.19. 


F-16,  HijHoo,  Uc  =  B  and  Ue  =  4,  response  to  a  unit  step  in  normal 
acceleration 


F-16,  HjfHoo,  Uc  =  8,  control  usage  for  a  unit  step  in  normal 
accderation 
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Figure  6.20.  F-16,  H2IH00,  «c  =  8,  closed-loop  sensitivity 


6.2.4  Modified  Problem.  As  discussed  in  Section  6.2.1,  the  wind  noise 
model  used  in  the  previous  problem  was  not  realistic.  An  improved  model  is  given 
here  where  the  wind  disturbance  enters  the  plant  as  an  angle  of  attack  perturbation. 
To  accomplish  this  we  must  modify  F  by  using 


-1.491 

9.753 


(6.39) 


This  results  in  By,  becoming 


By,  = 


-0.0333  0 
0.2181  0 


(6.40) 


The  remainder  of  the  problem  is  the  same  as  above. 


$ 


The  problem  was  solved  by  determining  the  optimal  controller  and  then 
applying  the  SQP  approach  to  iteratively  decrease  7  to  as  low  a  value  as  the  numerical 
approach  would  achieve.  Only  the  results  for  the  optimzil  H2  controUer  and  the  mixed 
controller  with  the  lowest  infinity- norm  (7  =  1.45)  will  be  discussed. 

For  this  example,  there  was  signiiic2intly  more  low  frequency  noise  present  in 
the  H2  design;  therefore,  the  resulting  open-loop  GK  transfer  function  had  more  low 
frequency  gain  as  seen  in  Figure  6.21.  This  result  can  also  be  seen  in  Figure  6.22 
which  shows  the  low  frequency  sensitivity  is  below  0  dB.  However,  Figure  6.23  revesds 
that  is  there  not  enough  gain  to  achieve  the  desired  tracking  performance.  The 
[—9.5  S.9]dB  vector  gain  margin  and  38.8°  vector  phase  margin  which  result  with 
the  optimal  H2  controller  are  acceptable.  Finally,  a  =  0.84  and  7  =  4981.0. 

After  completing  the  mixed  design,  the  final  controller,  with  7*  =  1.45  and 
a*  =  0.91,  W2U  selected  for  comparison  to  the  H2  controller.  As  can  be  seen  in  Fig¬ 
ures  6.21  and  6.22  the  mixed  controller  meets  the  desired  loop-shape  and  it  matches 
the  desired  sensitivity  much  better  than  the  H2  controller.  Furthermore,  the  tracking 
performance  shown  in  Figure  6.23  is  significantly  improved.  This  improvement  in 
performance  has  come  at  the  expense  of  a  reduction  of  the  vector  gain  margin.  The 
mixed  controller  results  in  a  [—5.8  \Q.Z]dB  gain  margin  and  40.7°  phase  margin. 
The  reduction  in  the  lower  gain  margin  is  acceptable  considering  the  improvement 
in  performance. 

Comparing  this  example  to  the  previous  one,  it  can  be  seen  that  the  addition 
of  a  larger  process  noise  in  the  H2  design  resulted  in  better  low  frequency  perfor¬ 
mance  and  margins.  The  previous  example  showed  that  these  objectives  can  also 
be  achieved  by  incorporating  a  weighted  sensitivity  J7oo  constraint  to  the  H2  prob¬ 
lem.  Therefore,  it  may  be  possible  to  use  the  H2  portion  of  the  mixed  problem 
to  determine  the  high  frequency  properties  of  the  resulting  system  (something  Hoo 
optimization  has  problems  with).  While  the  low  frequency  process  noise  in  the  H2 
problem  cannot  be  reduced  to  zero,  it  can  be  artificially  lowered  below  its  expected 
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Figure  6.21.  F-16,  Hi/Hoot  «c  =  4,  open-loop  GK,  improved  process  noise 
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Figure  6.22.  F-16,  H2/H00,  »c  =  4,  closed-loop  sensitivity,  improved  process  noise 
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Figure  6.23.  F-16,  HifHoo,  Wc  =  4,  response  to  a  unit  step  in  normed  acceleration, 

improved  process  noise 

level.  In  this  manner,  mixed  Ht/Hoo  optimization  can  be  used  to  design  a  controller 
which  achieves  desired  objectives  at  both  low  and  high  frequency. 

6.2.5  Convergence.  To  conclude  this  example,  a  discussion  of  the  conver¬ 
gence  of  the  numerical  search  algorithm  is  needed.  Using  Ridgely’s  method  [9]  on  a 
Sun  System  SPARC  2,  converging  one  point  on  the  mixed  curve  took  approximately 
one  week  of  computation  time.  The  DFP  approach  developed  here  can  converge 
a  controller  in  approximately  one  hour.  Finally,  the  SQP  method  can  converge  a 
controller  in  a  matter  of  minutes.  All  of  these  computation  times  increase  as  7 
approaches  7,  as  will  be  discussed  below.  While  the  SQP  and  DFP  methods  have 
a  significant  computation  time  advantage  over  previous  methods,  they  are  not  yet 
refined  enough  for  control  design  applications.  The  major  problem  with  the  methods 
arise  at  the  “knee”  of  the  curve,  the  point  where  there  is  a  significant  trade-off  in  a 
for  7.  This  knee  has  usually  been  found  to  occur  in  the  neighborhood  of  7,  as  one 
should  expect.  This  is  due  to  the  two-norm  of  the  system  tending  to  infinity  as  the 
optimal  Hoo  controller  is  approached. 
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At  the  knee  of  the  curve,  problems  with  multiple  peaks  in  the  maximum  singu¬ 
lar  value  curve  are  present.  The  multiple  peaks  result  in  the  gradient  of  the  infinity- 
norm  being  piecewise  continuous  over  the  optimization  parameter  space.  Thus,  for 
any  given  nominal  point,  the  resulting  gradient  may  only  be  good  for  a  small  neigh¬ 
borhood  of  the  point.  This  results  in  numerous  small  steps  being  taken  in  order  to 
converge  to  a  desired  7.  In  addition,  if  too  large  a  step  is  taken,  the  search  may 
depart  the  desired  region.  These  issues  are  still  open  and  will  require  further  refine¬ 
ment  to  improve  the  method  to  the  point  where  it  is  ready  for  everyday  application 
by  control  engineers. 

Finally,  the  SQP  method  wsis  able  to  converge  to  controllers  with  a  lower  value 
of  7  than  the  DFP  method.  This  was  partly  due  to  the  SQP  method  admitting 
unstable  closed-loop  system  during  the  search.  If  the  artificial  wall  approach  is  used, 
the  DFP  and  SQP  methods  had  about  the  same  performance  as  far  as  reducing 
7.  However,  the  SQP  method  converged  to  a  desired  7  with  a  lower  two-norm. 
Moreover,  the  SQP  required  fewer  iterations  and  function  evaluations  to  achieve 
these  better  results.  Therefore,  the  SQP  method  was  determined  to  be  a  better 
approach  for  solving  the  mixed  problem  numerically. 

6.S  Summary 

This  chapter  presented  two  approaches  for  computing  mixed  H2/H00  con¬ 
trollers  numerically.  The  first  method  converts  an  equality  constraint  to  a  penalty 
function  and  uses  the  Davidon-Fletcher-Powell  optimization  method.  The  second 
approach  appends  the  Hgo  constraint  as  an  inequality  constraint  and  uses  sequential 
quadratic  programming  to  converge  to  solutions.  Both  methods  have  advantages 
over  the  existing  method.  First,  they  allow  singular  Hgo  constraints.  Next,  feed¬ 
forward  terms  in  the  constraint  are  allowed.  Thirdly,  the  order  of  the  controller 
can  be  reduced  to  as  low  as  the  H2  order.  Finally,  both  methods  have  significant 
computation  advantages  over  the  previous  method. 
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The  SQP  method  was  found  to  converge  to  lower  values  of  the  Hoo  constraint 
due  to  the  fact  it  admits  infeasible  solutions.  In  particular,  it  allows  controllers 
which  result  in  an  unstable  closed-loop  system.  Thus,  the  SQP  method  imposes 
less  constraints  on  the  search  direction  and  results  in  faster  convergence  to  greater 
tolerances.  The  numerical  method  was  demonstrated  on  an  F-16  longitudinal  control 
problem.  The  example  demonstrated  the  trade-off  between  controller  order,  noise 
rejection,  performance,  and  margins  available  to  the  designer  using  the  mixed  Hi /Hoo 
method. 
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VIL  Mixed  Hz/fi  Optimal  Control 

The  F-16  example  in  the  last  chapter  demonstrated  how  mixed  H^lHoa  opti¬ 
misation  can  be  used  to  achieve  some  measure  of  robust  stability.  In  addition,  the 
closed-loop  system  had  the  desired  level  of  nominal  performance.  Recently,  there 
has  been  a  great  deal  of  interest  in  formulating  controllers  which  have  robust  perfor¬ 
mance  in  light  of  expected  system  uncertainties  (see  [2]  for  references).  Further,  it  is 
desired  that  a  system  have  minimal  response  to  noise  perturbations.  The  robust  per¬ 
formance  problem  has  been  successfully  addressed  in  the  p  framework  [2],  while  the 
noise  rejection  problem  can  be  formulated  as  an  problem.  This  chapter  considers 
the  joint  problem  of  designing  a  controller  which  rejects  noise  while  simultaneously 
providing  robust  performance. 

One  technique  for  designing  controllers  with  an  upper  bound  on  p  is  the  D-K 
iteration  developed  in  Section  3.4.2.  This  approach  is  an  iterative  method  which 
determines  an  optimal  scaling  matrix  D  and  an  associated  /Too  controller  K.  The 
method  results  in  a  controller  order  equal  to  that  of  the  original  plant  augmented 
with  the  scaling  matrices.  One  key  attribute  of  this  p-synthesis  method  is  it  uses  H^o 
techniques  for  controller  design.  The  controller  order  can  be  reduced  using  any  one 
of  several  available  order  reduction  methods,  but  we  desire  to  reduce  the  controller 
order  in  an  "optimal”  fashion,  where  optimal  is  defined  by  the  mixed  Hi! p  problem. 
Thus,  we  desire  a  mixed  HijHoo  optimization  problem  which  minimizes  the  two- 
norm  of  an  H2  transfer  function  and  provides  an  upper  bound  on  p  through  zm 
Hoo  transfer  function.  Furthermore,  ^-synthesis  can  result  in  a  non-strictly  proper 
controller  which  results  in  an  unbounded  two-norm  for  the  H2  transfer  function  in 
the  mixed  problem.  By  incorporating  the  mixed  H2/ H^-synthesis  method  into  the 
“K”  portion  of  the  D-K  iteration  process,  the  order  of  the  controller  and  bounds  on 
the  two-norm  can  be  addressed. 
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Figure  7.1.  Perturbed  closed-loop  system 


This  chapter  will  develop  the  Hi/n  problem.  The  method  is  based  on  a  fixed- 
order  controller,  and  the  order  can  be  reduced  to  as  low  as  that  of  the  underlying  H2 
problem.  Next,  the  robust  stability  and  robust  performance  problems  will  be  recast 
into  the  mixed  framework.  The  numerical  approach  from  Chapter  VI  will  be  modi¬ 
fied  to  handle  this  problem,  and  demonstrated  on  a  SISO  F-16  normal  acceleration 
control  design  problem  and  a  MIMO  HIMAT  longitudinal  control  design  problem. 

7.1  Mixed  Hi/ii 

This  section  incorporates  /t-synthesis  into  the  fixed-order  mixed  H2/H00  frame¬ 
work  from  Chapter  V.  Consider  the  closed-loop  system  Ted  with  a  block  diagonal 
structured  perturbation  A  shown  in  Figure  7.1.  Recall  from  Chapter  III  that  the 
set  of  all  dynamic  perturbations  which  have  the  desired  diagonal  structure  is  given 
by 

M( A)  :=  {A(s)  €  I  A(so)  e  A  for  all  so  e  }  (7.1) 

The  complex  structured  singular  value  of  a  dynamic  transfer  matrix  Tej(s)  over  the 
structured  perturbations  A(s)  €  Ad(A)  is  defined  by 

||red(s)||A  =  SUp^A  [Ted{j0>)]  (7.2) 

wen 
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Figure  7.2.  Mixed  Hijy.  problem 


Define  tbe  set  of  scaling  transfer  functions  D  which  have  the  same  block  diagonal 
structure  as  A,  where  each  individual  block  has  the  property  Di  =  D}  >  0.  Then, 
an  upper  bound  on  the  structured  singular  value  of  a  transfer  matrix  is  given  by 


l|T..l(.)IU  <  sup  M  W(VT^D-')  (7.3) 

=  (7.4) 

Thus  we  can  convert  a  p  constraint  into  an  Hoo  constraint. 

Let  Ted  be  the  closed-loop  transfer  function  from  d  to  e  in  Figure  7.2  with  the 
PK  loop  closed,  T^w  he  the  H2  transfer  function  of  interest  and  A  be  a  bounded 
energy  structured  perturbation.  Let  Doid  €  D  represent  a  scaling  transfer  function 
which  achieves  the  infimum  in  (7.4),  and  define 


T„t  :=  DoptTedD^ 


(7.5) 
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Figure  7.3.  Mixed  Hi|^l  boundary  plot 

An  upper  bound  on  /t  can  now  be  determined  by  finding  the  iniimum  of  over  all 
K  (i.  e.,  the  final  step  in  a  D-K  iteration).  Thus  2  is  minimum  upper  bound 
on  /i;  that  is,  the  minimum  achievable  value  of  from  D-K  iteration,  assuming  the 
controller  order  is  selected  to  be  large  enough.  Moreover,  achieves  a  minimum 
of  a  with  the  controller  and  there  is  a  corresponding  7  (>  2)  which  is  the 

upper  bound  on  n  corresponding  to  Thus,  the  problem  reduces  to  a  trade-off 

between  H2  performance  and  fi  performance  along  the  7  versus  a  curve  given  in 
Figure  7.3  for  2  <  7  ^  7- 

One  of  the  assumptions  made  in  setting  up  the  mixed  H2/11  problem  is  that 
the  scaling  transfer  function  Dopt  is  known,  which  is  generally  not  the  case.  However, 
this  transfer  function  can  be  approximated  using  existing  /^-synthesis  methods.  The 
proposed  algorithm  for  solving  the  mixed  optimal  control  problem  is  as  follows; 

i.  Compute  Dopt  using  ft-synthesis 

ii.  Define  := 

iii.  Compute  if 2^ ,  a,  and  7 
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iv.  Set  7*  to  the  desired  value 
V.  Compute  K^ix  «*  using  //j/Z/oo-synthesis 


T.2  Robust  Controllers  Using  H^/fi 

7.2.1  Robust  Stability.  Consider  the  perturbed  system  given  in  Fig¬ 
ure  7.1,  where  T^d  is  the  closed-loop  system  and  A  is  a  structured  uncertainty 
with  A  €  Ad(A),  the  set  of  all  stable  proper  transfer  functions  which  have  the 
desired  structure.  Then  the  following  theorem  provides  a  less  conservative  approach 
to  robust  stability  than  Zfoo  optimization  combined  with  the  Small  Gain  Theorem 
(Theorem  1.1.1). 

Theorem  7.2.1  Let  7  >  0.  The  loop  shown  in  Figure  7.1  is  well-posed  and  inter¬ 
nally  stable  for  o/l  A  €  M{A)  with  || A||oo  <\  if  ond  only  if 

\\Ted\\A  =  SUp/*A  [Ted{j(^)]  <  7  (7-6) 


Proof:  See  [44],  Theorem  3.6.  ■ 

Thus,  using  this  theorem  and  the  algorithm  from  above,  we  can  determine  an 
upper  bound  on  the  largest  perturbation  under  which  the  system  is  guaranteed  to 
be  robustly  stable.  Combining  this  with  the  mixed  framework,  a  trade-off  can  now 
be  made.  Either  the  level  of  noise  rejection  can  be  determined  for  a  given  level  of 
perturbation,  or  the  maximum  perturbation  can  be  determined  for  a  given  level  of 
noise  rejection.  More  likely,  the  trade-off  involves  finding  some  level  of  noise  rejection 
which  is  acceptable  given  the  resulting  level  of  robustness. 

7.2.2  Robust  Performance.  Consider  the  robust  performance  problem 
given  in  Figure  7.4,  where  Te,,^  is  the  transfer  function  for  the  desired  performance 
objective,  ||Te,dj||oo  <  7  (for  example,  output  sensitivity),  with  nj,  inputs  and 
outputs.  Ted  is  Ibe  closed-loop  system  and  A  is  a  structured  imcertainty  where 
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Figure  7.4.  Robust  performance  closed-loop  system 


A  €  A4(A),  the  set  of  all  stable  proper  transfer  functions  which  have  the  desired 
structure.  The  transfer  function  can  be  written  as  an  upper  fractional  trans¬ 
formation  of  Ted  ^<1  A,  denoted  —  Fu  {Ted}  A).  Our  performance  objective  can 
be  combined  into  the  perturbation  by  defining  an  augmented  perturbation 


A  0 

0  Ajp 


A  G  A,  Af  G 


(7.7) 


where  Af  is  a  fictitious  perturbation.  Robust  performance  can  now  be  determined 
using  the  following  theorem. 


Theorem  7.2.2  Let  7  >  0.  For  all  ^  E  A  with  ||  A||oo  <  the  loop  in  Figure  7-4 
is  well  posed,  internally  stable,  and  jlTc^^Hoo  ^  7  iff 


lircIlAp  := 

SUp/iAp  [Ted{j(^)] 

(7.8) 

< 

sup  inf  ff{DTedD~^)  <  7 

(7.9) 

Proof;  See  [44],  Theorem  3.7. 

■ 

Thus,  if  our  desired  level  of  performance  is  represented  by  WTe^d,  ||oo  <7?  we  can  guar¬ 
antee  this  performance  in  light  of  all  structured  perturbations  where  ||Af||oo  <  l/7if 


Figure  7.5.  (i  block  diagram 


and  only  if  ||!red||Ap  <  7-  Another  interpretation  of  this  theorem  is:  if  UTedHAp  =  7, 
then  robust  performance  is  guaranteed  to  a  level  of  |)oo  <  7  for  all  perturbations 
such  that  ||A|»||oo  <  1/7-  Now,  the  mixed  structure  developed  in  the  previous  sec¬ 
tion  can  be  used  by  defining  :=  DoptTejD^  and  applying  the  algorithm.  Again, 
a  trade-off  can  now  be  made  between  the  achievable  level  of  robust  performance  and 
H2  performance. 

7.S  Examples 

7.S.1  SISO  F-16  Design.  The  SISO  F-16  longitudinal  controller  de¬ 
sign  problem  from  the  previous  chapter  is  used  to  demonstrate  the  above  method. 
The  system  consists  of  a  short  period  approximation  of  a  continuous,  linear,  time- 
invarismt  normal  acceleration  command  system  augmented  with  a  pre-filter  for  the 
servo  dynamics  and  a  post-filter  to  model  the  control  delay.  The  plant  is  given  in 
Appendix  A. 

7.3. 1.1  Problem  Setup.  This  problem  is  solved  using  the  mixed 

method,  where  the  H2  portion  minimizes  the  effect  of  the  wind  disturbance  and 
measurement  noise,  provides  state  regiilation,  and  minimizes  control  power.  The  p 
portion  incorporates  performance  robustness. 

The  Jfj  portion  of  this  problem  is  identical  to  that  in  Section  6.2.4.  The 
p  problem  is  shown  in  Figure  7.5.  The  performance  objective  is  to  minimize  the 
weighted  output  sensitivity  in  light  of  an  input  multiplicative  perturbation.  The 
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sensitivity  weight  is  a  low-pass  filter  selected  to  improve  tracking  of  a  step  input 
based  on  the  desired  open-loop  GK  from  Section  6.2.2.  The  weight  is  given  by 


s-H.O 
a  +  0.0001 


(7.10) 


The  input  perturbation  represents  uncertainty  in  the  nominal  model  including  uncer¬ 
tainties  in  the  control  actuators,  aerodynamics,  flight  conditions,  aircraft  geometry, 
structural  bending,  and  other  unmodeled  high  frequency  dynamics.  The  weighting 
associated  with  this  perturbation  is  a  high-pass  filter  given  by 


50(^  +  100) 

‘  J  + 10000 


(7.11) 


This  weight  emphasizes  the  high  frequency  content  of  the  perturbation  set  we  are 
tr3ring  to  model.  For  a  good  discussion  on  the  choice  of  both  sensitivity  and  comple¬ 
mentary  sensitivity  weights,  the  reader  is  referred  to  [19]. 

The  closed-loop  system  is  now  formed  as 


T^  = 


WtKG{I  -  KG)-^  WtK{I  -  KG)-^ 
W,G{I  -  GK)-^  W,i,J  -  GK)-^ 


(7.12) 


The  scaling  Dopt  is  determined  using  the  hinf3yn,mu,  and  m-usynftt  routines 
from  MATLAB^**^  |i-Toolbox  [44].  These  routines  are  combined  to  perform  D-K 
iterations.  First  hinfayn  is  used  to  determine  a  nominal  closed-loop  system.  Then, 
mu  is  used  to  determine  the  value  of  ft  and  the  optimal  scaling  for  this  controUer. 
Finally,  muaynftt  is  used  by  the  operator  to  interactively  select  the  order  of  the 
scaling  D  which  best  approximates  the  optimal  scaling.  The  process  is  repeated 
imtil  n  is  converged  to  some  desired  level.  The  Hoo  transfer  function  is  then  formed 
as  T„,  =  DoptTedD^,  where  Dgpt  is  the  last  D  from  the  above  process.  The  Hoo 
matrices  are 
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-3849.04 

5737.46 

17039.10 

-161.38 

-2110.08 

-5737.46 

-18685.07 

11506.45 

-108.98 

-1424.93 

0 

0 

-1.49 

1.00 

-0.19 

0 

0 

9.75 

-0.96 

-19.04 

0 

0 

0 

0 

-20.00 

0 

0 

35.26 

-0.334 

-4.37 

0 

0 

-35.26 

0.334 

4.37 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

-38654.94 

-483.14 

0 

-4247.39 

2868.25 

-26103.56 

-326.26 

0 

-2868.25 

1936.92 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

-40.00 

0 

0 

0 

0 

80.00 

-0.0001 

0 

8.79 

-5.94 

0 

0 

10000.00 

0 

0 

0 

0 

0 

398.35 

2869.22 

0 

0 

0 

-2869.22 

-20621.99 

(7.13) 
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B,= 


-8.79 

0 

0 

-5.94 

0 

0 

0 

0 

0 

0 

0 

0 

0 

20.00 

Buoo  — 

20.0 

0 

0 

0 

0.02 

0 

0 

0 

0 

50.0 

8.79 

0 

0 

5.94 

0 

0 

(7.14) 


C7„  = 


483.19  -326.29  -1938.38  18.36  240.04 

0  0  0  0  0 

4397.42  54.96  0  483.19  -326.29 

0  0  -9900.00  0  0 


(7.15) 


^»oo  = 


0  0  -35.26  0.334  4.37  80.00  0  0  8.79  -5.94 


(7.16) 


= 


1.00 

0 

Dvu  = 

0 

Dy,  = 

r  1 

0.02  0 

0 

0 

50.0 

Dyu  =  [0]  (7.17) 


7.3. 1.2  Results.  The  process  is  initiated  by  computing  the  tenth  or¬ 
der  /t-synthesis  controller  given  in  the  last  row  and  column  of  Table  7.1.  A  Schur 
model  reduction  is  used  to  compute  reduced  order  controllers.  This  method  models 
the  plant  as  a  reduced  order  plant  with  an  additive  perturbation.  It  attempts  to 
reduce  the  infinity-norm  of  the  perturbation  and  therefore,  the  modeling  error.  A 
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Table  7.1.  F-16  Hifu  Optimization  Results 


Controller 

order 

Hi/n 

a  fi 

/t-synthesis 
(model  reduction) 
a  n 

4 

0.895 

2.34 

unstable 

6 

0.935 

1.98 

6.36  1.81 

8 

0.940 

1.77 

6.36  1.597 

10 

0.953 

1.71 

4.41  1.591 

Schur  decomposition  is  used  where  needed  and  the  resulting  method  is  more  numer¬ 
ically  robust  than  the  often  used  balanced  order  reduction.  The  reader  is  referred 
to  [62]  for  more  information  on  Schur  decomposition,  Schur  model  order  reduction, 
and  balanced  order  reduction.  The  tenth  order  controller  is  reduced  to  the  eighth 
and  sixth  order  /i-synthesis  controllers  jpven  in  Table  7.1.  A  stabilizing  fourth  or¬ 
der  controller  could  not  be  found  using  the  available  model  reduction  methods  in 
MATLAB^^  [44].  The  tenth,  eighth,  and  sixth  order  /i-synthesis  results  were  used 
as  initial  controllers  for  the  numerical  optimization,  and  mixed  controllers  were 
designed.  The  resulting  mixed  controllers  which  gave  the  best  trade-off  between  H2 
and  fi  performance  are  given  in  Table  7.1.  The  optimal  Hi  controller  is  used  as  the 
initial  controller  for  the  fourth  order  mixed  controller  and  the  resulting  best  mixed 
controller  is  also  given  in  Table  7.1. 

The  tenth  order  n  controller  has  the  best  level  of  robust  performance,  but 
it  also  has  a  high  level  of  high  frequency  noise  response,  as  shown  in  Figure  7.6. 
By  comparison,  the  tenth  order  Hi  In  controller  has  robust  performance  for  slightly 
smaller  perturbations  since  the  upper  bound  on  /i  is  8%  higher;  therefore,  the  nominal 
performance  is  also  decreased  as  is  seen  in  Figure  7.7.  However,  the  mixed  controller 
has  better  high  frequency  noise  response,  as  is  expected,  since  the  two-norm  is  about 
one  fourth  the  size  of  the  two-norm  with  the  /i  controller.  Moreover,  Figures  7.8  and 
7.9  show  that  the  control  usage  is  considerably  reduced  with  the  mixed  controller. 
Again,  this  result  is  expected  since  the  Hi  portion  of  the  mixed  controller  includes  a 
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penalty  on  control  usage,  while  /^-synthesis  does  not  take  this  into  account.  Similar 
results  can  be  seen  for  the  eighth  and  sixth  order  results  shown  in  Figures  7.10-7.17. 

One  advantage  of  the  mixed  approach  in  this  example  is  the  consistent  ability 
to  find  a  stabilizing  controller  at  orders  as  low  as  the  H2  order;  in  this  case  fourth 
order.  Model  reduction  techniques  resulted  in  non-stabilizing  fourth  order  controllers 
for  the  /i-synthesis  approach,  but  the  mixed  approach  is  able  to  compute  a  stabilizing 
fourth  order  controller.  As  can  be  seen  in  Table  7.1,  the  upper  bound  on  fi  for  the 
fourth  order  controller  is  47%  greater  than  the  /i-synthesis  tenth  order  controller; 
thus,  the  perturbation  size  for  robust  performance  is  reduced.  Nominal  performance 
is  also  decreased  with  the  peak  overshoot  increased  from  about  0.5  g  to  0.7  g,  and 
the  settling  time  is  about  the  same  for  both.  The  high  frequency  noise  rejection  is 
improved  fourfold  with  the  mixed  fourth  order  controller  as  compared  to  the  tenth 
order  /i-synthesis  controller.  These  results  can  be  seen  in  Figures  7.18  and  7.19. 

The  vector  margins  for  the  resulting  controllers  are  given  in  Table  7.2.  As  can 
be  seen,  the  tenth  order  /i-synthesis  controller  resulted  in  the  best  margins.  Although 
the  tenth  and  eighth  order  H2I11  controllers  resulted  in  decreased  margin,  it  is  an 
acceptable  trade-off  for  the  increased  noise  rejection.  Notice  that  the  sixth  order 
H2IH  controller  has  better  upper  gain  margin  and  phase  margin  than  the  tenth  and 
eighth  order  .fliZ/i  controllers.  This  is  due  to  the  trade-off  between  performance  and 
margins  which  occurs  at  the  knee  of  the  a  versus  7  curve;  su  7  is  approached,  there 
is  an  underlying  trade-off  which  is  made  to  minimize  7.  The  fourth  order  .^^2//^ 
controller  resulted  in  significsmtly  reduced  meirgins.  Therefore,  a  design  decision 
must  be  made  between  the  order  and  the  desired  margins. 

Finally,  the  response  of  the  system  to  an  initial  5°  angle  of  attack  perturbation 
is  given  in  Figure  7.20.  Notice  that  there  is  no  significant  difference  in  regulation 
between  the  controllers.  This  indicates  that  the  increased  two-norm  is  due  almost 
entirely  to  the  increase  in  response  to  high  frequency  noise  and  increased  control 
usage,  as  is  seen  in  the  time  responses. 
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Figure  7.6.  F-16,  step  response,  10th  order  fi  controller 


Figure  7.7.  F-16,  step  response,  10th  order  H^/ft  controller 
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tiinB(ne) 

Figure  7.8.  F- 16, control  usage  for  step  response,  10th  order  /i  controller 


Figure  7.9.  F-16,  control  usage  for  step  response,  10th  order  H2//1  controller 


Figure  7.10.  F-16,  step  response,  8th  order  /t  controller 


Figure  7.11.  F-16,  step  response,  8th  order  H^ftt  controller 
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Figure  7.12.  F-16,  control  usage  for  step  response,  8th  order  n  controller 


Figure  7.13.  F-16,  control  usage  for  step  response,  8th  order  Hi/ pi,  controller 
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Figute  7.14.  F-16,  step  response,  6th  order  fi  controller 


Figure  7.15.  F-16,  step  response,  6th  order  ffj//*  controller 
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Figure  7.16.  F-16,  control  usage  for  step  response,  6th  order  ft  controller 


Figure  7.17.  F-16,  control  usage  for  step  response,  6th  order  .82/^  controller 
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Figure  7.18.  F-16,  step  response,  4th  order  Hijpi  controller 


Figure  7.19.  F-16,  control  usage  for  step  response,  4th  order  H'^hi  controller 
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Figure  7.20.  F-16,  initial  5°  angle  of  attack  perturbation  response 

Based  on  these  results,  the  designer  must  make  a  choice  of  controller  order. 
Since  performance  is  not  considerably  different  for  all  the  mixed  controllers,  the 
primary  factor  in  the  decision  is  the  trade-off  between  order  and  robustness.  If  the 
expected  perturbations  are  known  to  have  an  infinity-norm  less  than  1/2.34,  then 
the  fourth  order  controller  is  the  best  choice.  However,  if  larger  perturbations  are 
expected,  the  controller  order  will  have  to  be  increased  to  remain  robust. 

l.S.Z  MIMO  HIM  AT  Design.  A  longitudinal  controller  design  problem 
for  the  HIMAT,  a  highly  maneuverable,  remotely  piloted,  technology  demonstration 
vehicle,  is  used  to  demonstrate  the  mixed  approach  for  MIMO  problems  and  to 
demonstrate  further  application  of  mixed  H2I11.  The  model  is  taken  from  data  for 
the  HIMAT  vehicle  [44].  The  model  is  a  four-state,  continuous,  linear,  time-invari2int, 
description  of  the  short  period  and  phugoid  modes.  The  control  inputs  are  elevon 
(Se)  and  canard  (Sc)  deflections  JUid  the  measured  outputs  are  angle  of  attack  (a) 
and  aircraft  attitude  (^).  A  block  diagram  of  the  system  is  given  in  Figure  7.21.  The 
plant  and  simulation  truth  model  are  given  in  Appendix  B. 
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Figure  7.21.  HIM  AT  system  block  diagram 

7.S.2.1  Hq  Regulator.  The  H2  portion  of  the  control  design  is  based 
on  a  standard  Linear  Quadratic  Gaussian  (LQG)  problem.  A  wind  disturbance  is 
modeled  as  an  angle  of  attack  perturbation  by  a  zero-mean  white  Gaussian  noise  of 
intensity  5.0  x  10"^  rad’-sec  and 

-36.6 
-1.90 
-11.7 
0 

The  measurements  are  corrupted  by  zero-mean,  white  Gaussian  noises  of  strength 
1.6  X  10~®  deg’-sec  (IVn  =  /).  The  controlled  outputs  for  the  LQG  design  are  control 
usage  and  state  perturbations  with  unit  weightings  {p  =  10  and  H  =  I). 

Thus,  the  H2  problem  is  set  up  to  design  a  minimum  control/state  regulator 
operating  in  the  face  of  process  and  measurement  noises.  No  attempt  is  made  to 
force  the  system  to  track  a  step  or  guarantee  vector  margins  for  the  closed-loop 
system.  Robust  performance  will  be  achieved  through  the  use  of  p  constraints.  The 
resulting  controller  is  fourth  order,  and  the  minimum  two-norm  of  the  closed-loop 
system  with  A’2^  is  a  =  0.20. 


(7.18) 
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Figure  7.22.  HIMAT,  controller-velocity  response  to  initial  5°  angle  of  attack 
perturbation 

The  Hi  regulation  is  shown  in  Figures  7.22-7.25  for  a  initial  5°  angle  of  at¬ 
tack  perturbation.  The  Hi  controller  provides  good  regulation  with  minimal  noise 
response.  The  control  usage  in  Figure  7.26  shows  there  is  little  response  to  high 
frequency  noises. 

The  response  of  the  system  to  unit  step  in  angle  of  attack  and  pitch  angle 
are  given  in  Figures  7.27 — 7.32.  Notice  that  the  Hi  solution  is  not  an  acceptable 
tracker,  but  does  have  acceptable  noise  rejection,  particularly  at  high  frequency. 
Furthermore,  the  control  usage  is  minimal,  but  not  unexpected  since  there  is  no 
apparent  tracking. 

7.S.2.2  Robust  Performance.  The  mixed  controller  objective  is  to 
design  a  controller  such  that  the  closed-loop  system  has  robust  performance  measured 
at  the  output  vrith  an  input  disturbance  perturbation.  This  problem  is  solved  by 
appending  the  performance  objective  as  a  fictitious  perturbation  smd  combining  it 
with  '  ’e  disturbance  into  a  structured  perturbation.  The  controller  is  then  designed 
using  the  mixed  framework. 
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Figure  7.23.  HIMAT,  controller-angle  of  attack  response  to  initial  5°  angle  of 
attack  perturbation 


Figure  7.24.  HIMAT,  H2  controller-pitch  rate  response  to  initial  5°  angle  of  attack 
perturbation 
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Figure  7.25.  HIMAT,  Hi  controller-pitch  angle  response  to  initial  5°  angle  of  attack 
perturbation 


time  (sec) 


Figure  7.26.  HIMAT,  Hi  controller-control  usage  for  an  initial  5°  angle  of  attack 
perturbation 
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Figure  7.27. 


Figure  7.28. 


HIMAT,  H2  controller-angle  of  attack  response  to  angle  of  attaek  unit 
step  input 


HIMAT,  H2  controller-pitch  angle  response  to  angle  of  attack  unit 
step  input 
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Figure  7.29.  HIMAT,  H3  controller-control  usage  for  angle  of  attack  unit  step  input 
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Figure  7.30.  HIMAT,  controller-angle  of  attack  response  to  pitch  angle  unit 
step  input 
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The  disturbance  enters  the  system  at  the  input  to  the  plant  and  is  modeled  as 
a  high  frequency  perturbation  by  appending  a  high-pass  filter  at  the  output  ei.  The 
perturbation  filter  transfer  function  is 


Wm{s) 


50(s  +  100) 

i+ 10000 


(7.19) 


The  performance  objective  is  to  track  a  step  at  the  output.  The  fictitious  “perfor¬ 
mance  perturbation”  is  modeled  by  a  low-pass  filter  appended  at  the  output  ej.  The 
performance  filter  transfer  function  is 


Wpis) 


0.5(s-H3) 
a  +  0.03 


(7.20) 


The  system  is  considered  to  have  robust  performance  to  structured  perturba¬ 
tions  A  €  Af(A)  where  |(A||oo  <  7  if 

WT^Wa  <  i  (7.21) 

where  Te^  is  the  closed-loop  system 

\W^KG(I-KC)-^  W^Kil-KG)-'} 

"*  WpG(I-GK)-'  Wp(I-GK)-' 

In  this  particular  case,  it  is  desired  to  have  7  <  1. 

The  first  step  in  the  process  is  to  compute  the  best  n  controller.  A  20th  order 
controller  is  found  using  the  MATLAB^'^  mvsynftt  function  [44]  which  achieves  the 
desired  level  of  robust  performance.  A  third  order  fit  is  used  which  results  in  a  sixth 
order  D  transfer  function.  The  resulting  controller  order  is  the  sum  of  the  four  model 
states,  the  two  performance  weighting  states,  the  two  perturbation,  and  two  times 
the  six  states  of  the  scaling  matrix  D,  or  20th  order.  The  response  of  the  system 
to  unit  steps  in  angle  of  attack  and  pitch  wgle  are  given  in  Figures  7.33-7.38.  This 
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Figure  7.33.  HIMAT,  fi  controller-angle  of  attack  response  to  angle  of  attack  unit 
step  input 

controller  possesses  good  tracking  of  both  angle  of  attack  and  pitch  angle  inputs. 
Further,  the  control  usage  is  not  excessive  after  an  initial  large  transient.  Notice 
that  the  response  to  high  frequency  noise  is  increased  over  that  of  the  system. 

The  objective  now  is  to  attempt  to  reduce  the  order  of  the  controller  and  im¬ 
prove  the  high  frequency  response  using  the  mixed  approach.  It  should  be  mentioned 
that  model  reduction  of  the  n  controller  can  be  used.  In  this  case,  a  Schur  model  re¬ 
duction  method  was  attempted  for  16th,  12th,  8th,  and  4th  order  controllers,  but  all 
the  resulting  controllers  suffered  from  large  increases  in  /i  and  thus  did  not  provide 
an  acceptable  level  of  performance  robustness. 

7.S.2.S  ffj/iii.  The  mixed  optimization  problem  is  set  up  by  defining 

n,  =  (7.23) 

where  Dopt  is  determined  from  the  previous  ^-synthesis.  The  mixed  problem  is  then 
solved  using  the  inequality  constraint  approach  with  ein  SQP  algorithm.  It  is  desired 
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Figure  7.35.  HIMAT,  n  controller-control  usage  for  angle  of  attack  unit  step  input 
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Figure  7.36.  HIM  AT,  fi  contioUer-angle  of  attack  response  to  pitch  angle  unit  step 
input 


Figure  7.37.  HIM  AT,  fi  controller-pitch  angle  response  to  pitch  angle  unit  step 
input 
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Figure  7.38.  HIMAT,  ft  controller-control  usage  for  pitch  angle  unit  step  input 
Table  7.3.  HIMAT  Ht/ii  Optimization  Results 


Controller 

order 

a 

H2 

4 

0.20 

6808.1 

20 

44.2 

0.987 

H,/fi 

4 

7.0 

1.20 

8 

6.9 

1.11 

to  find  a  low  order  controller;  in  this  case,  the  order  of  the  H2  problem  or  Uc  =  4. 
This  does  not  imply  that  lower  order  controllers  don’t  exist;  in  fact,  this  approach 
can  be  applied  to  design  controllers  with  order  less  than  the  order,  but  there  is 
no  guarantee  that  7*  =  7  for  the  optimum  or  even  that  a  stabilizing  controller  exists. 

Table  7.3  presents  a  comparison  of  the  H2,  p,  and  mixed  H2I11  results.  Notice 
that  the  fourth  order  mixed  controller  provides  robust  performeince  to  perturbations 
that  have  a  norm  bound  which  is  83%  of  desired.  Furthermore,  this  controller  has 
a  two-norm  which  is  almost  an  order  of  magnitude  less  than  the  two-norm  of  the  ^ 
controller,  but  nearly  two  orders  of  magnitude  greater  than  the  H2  controller. 
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Figure  7  39.  HIMAT,  rie  =  4,  angle  of  attack  response  to  angle  of  attack 

unit  step  input 


Figures  7.39-7.44  show  the  impact  of  these  results.  Comparing  the  step  re¬ 
sponses  to  those  of  the  20th  order  n  controller,  it  is  seen  that  the  fourth  order  mixed 
controller  has  a  slower  initial  response  to  a  step,  but  reaches  steady  state  at  ap¬ 
proximately  the  seune  time  as  the  fi  controller.  Moreover,  the  high  frequency  noise 
rejection  is  seen  to  be  about  the  same-in  fact,  the  mixed  controller  results  in  slightly 
better  noise  rejection,  but  it  is  not  significantly  better  than  the  noise  rejection  when 
the  fi  controller  is  used.  Notice  that  the  initial  control  usage  is  higher  for  the  mixed 
controllers  but  then  it  drops  off  faster  2is  steady  state  is  approached.  Finally,  the  fi 
controller  2uid  the  fourth  order  mixed  controller  regulate  the  states  equally  well  to 
an  initial  angle  of  attack  perturbation  (not  shown). 

The  last  controller  computed  for  this  problem  is  an  eighth  order  mixed  con¬ 
troller.  As  can  be  seen  from  Table  7.3,  the  eighth  order  mixed  controller  has  a  greater 
level  of  robustness  than  the  fourth  order,  but  still  does  not  meet  the  desired  level 
of  1.0.  The  time  responses  for  this  controller  are  comparable  to  that  of  the  fourth 
order  and  are  not  shown.  This  process  could  be  continued  with  high  order  controllers 
until  the  desired  level  of  robustness  is  met.  Since  robust  performance  is  obtained  by 
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Figure  7.40. 


Figure  7.41. 


HIMAT,  H2fn,  Tie  =  4,  pitch  angle  response  to  angle  of  attack  unit 
step  input 


HIMAT,  Hilfi,  Tic  =  4,  control  usage  for  angle  of  attack  unit  step 
input 
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Figure  7.42. 


Figure  7.43. 


HIMAT,  Hi/ fly  Uc  =  4,  angle  of  attack  response  to  pitch  angle  unit 
step  input 


HIMAT,  Hi/ fly  Uc  ~  4,  pitch  single  response  to  pitch  angle  unit  step 
input 
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Figiue  7.44.  HIM  AT,  tie  =  4,  control  usage  for  pitch  angle  unit  step  input 

the  20th  order  n  controller,  a  mixed  controller  which  guarantees  robust  performance 
with  order  less  than  or  equal  to  20  exists.  This  example  has  demonstrated  the  ca¬ 
pability  of  the  mixed  Htjn  method  to  reduce  the  controller  order.  Furthermore,  the 
reduced  order  controller  retained  desirable  robustness  qualities. 

7.^  Summary 

^-analysis  and  synthesis  were  seen  to  provide  the  design  engineer  with  an 
improved  mea.sure  of  robust  stability.  Moreover,  ft  is  currently  the  best  way  for 
designing  systems  with  robust  performance.  However,  y,  controllers  cannot  handle 
white  noise  inputs,  and  generally  result  in  high  order  controllers.  By  incorporat¬ 
ing  y  into  the  mixed  HjfHoo  approach,  both  of  these  limitations  were  addressed. 
The  Hoo  constraint  was  formed  by  scaling  the  transfer  function  with  the  D  transfer 
function  from  the  last  D-K  iteration  step  of  a  y  design.  Then  the  mixed  method 
from  the  previous  chapter  weis  applied.  An  F-16  and  HIMAT  longitudinal  control 
design  examples  demonstrated  the  H2/y  optimization.  Significant  reduction  in  both 
controller  order  eind  high  frequency  noise  response  were  obtained  using  the  mixed 
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st  the  fi  controller.  This  improvement  was  at  the  expense  of 
abust  performance  of  the  system. 
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VIII.  Multiple  Hqo  Constraints 

Multiple  Hoa  constraints  arise  in  many  control  problems.  Consider  the  multiple 
input /multiple  output  system  in  Figure  8.1,  where  G  represents  the  plant  to  be 
controlled,  K  is  the  controller  to  be  designed,  Wi  Ai  represents  an  input  perturbation 
to  the  system,  and  IF2A2  represents  a  fictitious  “performance  perturbation”.  The 
problem  is  to  design  a  controller  which  is  robustly  stable  to  perturbations  at  the 
input  and  has  nominal  performance  at  the  output.  One  approach  to  this  problem  is 
to  combine  the  perturbations  into  a  single  A,  bringing  the  weights  Wi  and  W2  into 
the  system  as  shown  in  Figure  8.2. 

The  resulting  Hoo  problem  is  to  find  a  controller  which  reduces  the  infinity- 
norm  of  the  closed-loop  transfer  function  M  to  a  value  less  than  or  equal  to  the 
inverse  of  the  infinity-norm  of  the  perturbation  A,  or 


IIMIlco  < 


1 

IIAIloo 


where 


A  = 


Ai  0 

0  A, 


A  common  choice  of  M  [39]  is 


(8.1) 


(8.2) 


M  = 


WiT  * 

*  IVjS 


(8.3) 


where  T  end  S  are  the  input  complementeury  sensitivity  and  the  output  sensitivity, 
respectively,  eind  -k  are  picked  to  meike  the  problem  a  reguletr  Hoo  problem.  This 
approach  guarantees  the  stability  emd  performeince  requirements  eire  met  when  the 
inequality  (8.1)  is  satisfied.  Generedly,  the  resulting  controller  is  very  conservative 
with  regard  to  the  actual  perturbations  Ai  and  A3. 
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Figure  8.2.  System  with  uncertainties  “ptilled  out” 
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A  less  conservative  choice  for  M  is 


(8.4) 


While  this  is  less  conservative,  the  problem  cannot  usually  be  solved  by  available 
state-space  techniques  since  it  results  in  a  singular  Hga  problem. 

An  even  less  conservative  approach  is  to  separate  the  perturbations  into  two 
Hoo  problems 


IliViriU  < 

1 

(8.5) 

IIAllloo 

1 

(8.6) 

IIA^Iloo 

There  is  no  convenient  way  of  solving  this  problem  under  the  current  Hoo  optimal 
control  theory.  However,  a  controller  which  meets  the  desired  Hoo  constraints  can  be 
found  using  mixed  Hi/ Hoo  optimal  control.  This  method  has  the  added  advantage  of 
minimizing  the  effect  of  white  noise  on  selected  controlled  outputs  from  the  system. 

Another  approach  to  solving  this  problem  is  to  use  ^-synthesis  through  D-K 
iterations.  This  method  has  the  advantage  of  not  oidy  finding  a  controller  which 
provides  robust  stability  and  nominal  performance,  but  also  provides  a  measure  of 
robust  performance.  The  ability  of  ^-synthesis  to  provide  robust  performance  is  due 
to  its  exploitation  of  frequency  information  as  well  as  the  block-diagonal  structure 
of  the  perturbation.  The  mixed  H^jHoo  optimal  control  method  exploits  the  block- 
diagonal  structure  of  the  perturbation,  but  oidy  contains  peak  gain  information 
provided  by  the  infinity-norm  and  does  not  have  the  same  frequency  information  as  fi- 
synthesis.  Furthermore,  the  cross-terms  in  8.3  are  not  considered  by  the  multiple  Hoo 
cons^^aint  approach  as  they  are  in  /t-synthesis.  Therefore,  the  resulting  controller  will 
not  guarantee  robust  performance.  The  mixed  approach  does,  however,  guarantee 
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a  controller  which  provides  robust  stability  and  nominal  performance  at  controller 
orders  as  low  as  the  H2  order. 

The  above  example  is  the  simplest  case  of  a  multiple  constraint  problem.  How¬ 
ever,  the  design  engineer  is  often  interested  in  performance  and  margins  at  more 
than  just  one  point  in  the  system.  Using  the  multiple  Hoo  constraint  framework, 
robustness  to  multiplicative  perturbations  at  the  input  and  the  output  as  well  as 
additive  perturbations  (and  the  inverses  of  all  of  the  above)  can  be  accounted  for 
simultaneously.  Further,  any  other  desired  constraint  such  as  control  power  Umits 
can  be  augmented  to  the  problem  in  this  frzimework.  Thus,  the  mixed  H2/ Hoo  opti¬ 
mal  control  problem  with  multiple  Hoo  constraints  is  a  powerful  tool  which  provides 
substantial  flexibility  in  control  design  and  trade-off  analysis.  The  application  of 
multiple  constraint  mixed  optimization  problems  which  include  fi  will  be  examined 
further  in  the  next  chapter. 

The  objective  of  the  first  section  of  this  chapter  is  to  characterize  the  optimal 
(order-free)  solution  to  the  mixed  H2IH00  optimization  problem  with  multiple  con¬ 
straints.  The  conditions  for  fixed-order  controllers  wfil  then  be  presented.  Finally, 
the  numerical  methods  developed  in  Chapter  VI  wiU  be  extended  to  include  multiple 
constraints  and  the  F-16  longitudinal  control  problem  will  be  used  to  demonstrate 
the  methods. 

8.1  Uniqueness  of  the  Optimal  Controller 

This  section  will  extend  the  results  of  Chapter  IV  to  the  H2IH00  optimal 
control  problem  with  multiple  Hoo  constraints.  Consider  the  system  in  Figure  8.3, 
where  df,  t  =  1, . . .  ,noo,  are  of  bounded  energy  and  w  is  zero-mean,  white  Gaussian 
noise. 

The  transfer  function  P  is  the  underlying  plant  G  with  all  weights  associated 
with  the  problem  absorbed.  It  is  assumed,  in  general,  that  there  is  no  relationship 
between  Ci,i  =  l,...,n«„  and  z  or  d^,*  =  l,...,noo>  and  w.  As  before,  the  aug- 
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Figure  8.3.  General  mixed  Ht/H^  optimization  problem 

mented  plant  P  is  formed  by  wrapping  the  weights  from  an  Hi  problem  from  w  to 
z  and  the  weights  of  the  JFfoo  problems  from  di  to  ei  around  the  basic  system.  To 
simplify  the  discussion,  the  following  additional  definitions  are  made: 


As  in  the  Chapter  IV,  this  problem  can  be  formulated  as  a  convex  program 
through  a  Youla  parametrization  as  shown  in  Figure  8.4.  The  convex  progreun  is: 
find  &  Q  £  Hi  which  satisfies 

a  =  inf  ||T*,j,||2 

^  '  subject  to  (8-11) 

||oo  ^  T*  *  “  ^1  •  •  •  >  ^oo 

This  problem  is  more  complicated  than  the  single  constraint  problem  due  to 
the  nature  of  the  regions  where  solutions  can  exist.  In  the  single  constraint  problem 
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Figure  8.4.  J-Q  paxametrization  of  the  mixed  ffj//foo  problem 


shown  in  Figures  4.3  and  4.4,  there  are  only  two  possibilities;  either  the  controller  is 
the  optimal  controller,  or  it  is  a  controller  which  satisfies  the  Hoo  constraint  with 
equality.  However,  for  the  multiple  Hoo  constraint  problem,  there  are  more  regions 
to  consider  in  order  to  determine  the  nature  of  the  mixed  controller. 

Consider  the  mixed  problem  with  two  Hoo  constraints,  where  71  £md  72  are 
specified.  Figure  8.5  presents  the  four  possible  regions  in  the  Hoo  constraint  plane 
where  the  values  of  71  and  72  can  be  chosen.  Note  that  the  point  (71,72)  in  this  plane 
indicates  the  point  at  which  both  inequality  constraints  are  satisfied  with  equality. 
We  will  denote  the  actual  mixed  solution  by  {7j,7j).  Region  IV  is  defined  as  the 
region  where  71  >  7i  and  72  >  72-  Region  II  is  defined  by  71  <  7^  and  72  greater 
than  or  equal  to  the  value  of  UTedgUoo  when  a  Kmi*  from  the  ff2/lir«<ii  |loo  curve  (that 
is,  the  single  constraint  mixed  controller)  is  used  to  form  Tei,  at  a  given  value  of  71. 
This  value  of  72  will  be  denoted  72.  Similrirly,  Region  III  is  defined  like  Region  II 
but  with  7i,  72  and  Tai^ ,  T^dt  changing  roles,  and  71  is  the  value  of  71  on  the  optimal 
mixed  ifa/HTa^ljoo  curve.  Finally,  Region  I  is  defined  by  the  values  of  71  and  72  less 
than  those  given  by  the  optimal  mixed  single  constraint  curves,  but  greater  than 
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Optimal  Curve 


the  miiumai  values  achievable  for  a  two-constraint  problem.  The  lower  left  corner  of 
Region  I  does  not  necessarily  reach  the  intersection  of  the  lines  71  =  “^*1  7a  ~  22' 

this  is  due  to  existence  questions  in  this  region  which  will  be  discussed  later.  In 
particular,  the  point  (2j>2j)  is  most  likely  not  achievable. 

Figure  8.6  shows  a  three-dimensional  plot  of  the  surface  formed  by  plotting 
corresponding  values  of  a*,  71,  emd  75.  This  is  the  mixed  lir^||2/llTedi||oo/|lT’edj||oo 
surface.  With  this  surface  in  mind,  we  will  use  some  geometric  insight  to  determine 
the  nature  of  the  solution  for  each  region.  Starting  with  Region  IV,  one  can  see  from 
Figure  8.7  that  the  optimal  H2  controller  is  in  the  admissible  region — since  this  is 
the  global  optimal,  it  is  the  solution  to  the  mixed  problem  in  this  region.  Thus,  for 
(71,7a)  in  Region  IV,  the  optimal  mixed  solution  is  (7^,7^)  =  (71,72)- 

In  Region  II,  the  admissible  region  can  be  seen  in  Figure  8.8.  The  minimum 
value  of  a  will  be  achieved  on  the  optimal  R2/||Te*||oo  curve.  Thus,  (7^,7^)  = 
(71,73)  in  Region  II.  Similar  results  will  occur  for  Region  III,  so  (7r,7^)  =  (71.72) 
in  Region  III. 


H2  Optimal 
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Figure  8.8.  Admissible  solutions-Region  II 


For  Region  I,  the  admissible  region  is  shown  in  Figure  8.9.  The  geometric  in¬ 
sight  from  Figure  8.6  is  that  the  solution  will  fall  at  the  intersection  of  the  constraint 
boundaries;  i.  e.,  (71,72)  =  ill, 'ft) 

The  following  theorem  will  confirm  this  insight.  First,  define  Kmixiili)  as  the 
unique  optimal  controller  for  the  mixed  H2f\\Te4^  ||oo  problem  at  a  fixed  71.  Kmim^ili) 
is  defined  in  a  similar  fashion. 


Theorem  8.1.1  Assume  rioo  =  2  (i.  e.,  there  are  2  di’s  and  2  Si’s)  and  let  71  and 
73  be  given.  If  a  controller  K  which  solves  the  convex  program  (8.11)  exists,  then  it 
is  unique  and  K  is  given  by: 

i.  If 'yi  <  7i  and  72  <  72  (Region  I)  then  the  optimal  controller  K  must  satisfy 
both  Hoo  constraints  with  equality. 

**•  If  I2  >  12  and  7i  <  7i  (Region  11)  then  K  =  Jfifm«,(7i) 

*«•  Ifli  >  7i  and  72  <  72  (Region  III)  then  K  =  ifmi»,(72) 

iv.  If'yi  >  7i  and  72  >  73  (Region  IV)  then  K  =  . 
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Hj/IITej^ll^  Optimal  Curve 


H2  Optimal 


III 

Optimal  Curve 

ii  Y,  % 

Figure  8.9.  Admissible  solutions-Region  I 


Proof:  Prom  Lemma  4.1.1,  the  two-norm  is  a  strictly  convex  functional;  therefore, 
from  the  corollary  to  Theorem  9.4.1  [35],  any  solution  to  the  convex  prograun  (8.11) 
is  unique. 


i.  Define  the  Lagrangian 


c  =  (||r«,.||oc  -  71)  +  A,  (IITe^JU  -  72)  (8.12) 

If  neither  constraint  is  satisfied  with  equality,  then  the  Kuhn- Tucker  conditions 
imply  Ai  =  A2  =  0.  The  problem  reduces  to  the  optimal  H2  control  problem 
which  has  the  unique  solution  K2^t.  However,  referring  to  Figure  8.9,  it  can 
be  seen  that  this  solution  is  not  admissible.  Therefore,  at  least  one  constraint 
must  be  satisfied  with  equality.  Now,  eissume  7^  =  71  and  7^  ^72,  which 
implies  A3  =  0.  The  Lagrangian  reduces  to 

c  =  r^||2  +  Ax  (||7;<x, lU  -  71)  (8.13) 
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which  is  the  Lagrangian  associated  with  the  mixed  ||oo  optimal  control 

problem,  which  w:w  shown  in  Theorem  4.2.1  to  have  a  unique  solution.  Again 
referring  to  Figure  8.9,  it  can  be  seen  that  this  solution  is  not  in  the  admissible 
region;  thus,  7^  =  72.  A  similar  argument  can  be  made  for  72  =  72  and  7^  ^71. 
Thus,  the  only  remaining  possibibty  is  (71,72)  =  (7i»72)- 

ii.  Assume  neither  constraint  is  satisfied  with  equality.  Again,  the  only  controller 
which  satisfies  the  Kuhn-Tucker  conditions  is  A'2^,,  which  is  not  in  the  ad¬ 
missible  region  as  shown  in  Figure  8.8.  Thus,  at  least  one  constraint  must  be 
satisfied  with  equality.  Assume  now  that  7i  =  71  and  72  ^  72  which  impUes 
A2  =  0.  The  Lagrangian  then  reduces  to  (8.13)  for  which  the  Kuhn-Tucker 
conditions  are  satisfied  by  the  unique  Kmixii'yi)}  which  is  in  the  admissible  re¬ 
gion.  Since  the  optimal  solution  is  unique,  (71 )  is  the  optimal  controller 

for  Region  II. 

iii.  The  proof  is  analogous  to  that  of  ii. 

iv.  Assume  neither  constraint  is  satisfied  by  equality.  Then  (8.12)  reduces  to  the 
H3  problem  and  K3^  is  admissible;  therefore,  it  is  the  optimal  solution. 

■ 

The  question  of  existence  of  a  solution  still  needs  to  be  addressed.  In  the  single 
constraint  problem,  controllers  existed  for  all  7  >  7.  For  the  two-constraint  problem 
where  the  constraint  intersection  falls  in  Regions  II,  III,  and  IV,  the  existence  of  a 
solution  is  guaranteed  by  the  definition  of  the  boundaries.  However,  in  Region  I, 
there  is  a  question  of  existence  of  solutions  in  the  neighborhood  of  the  intersection 
of  7^  and  Tj,  as  depicted  by  the  dashed  curve  in  Figure  8.5.  There  is  no  guarantee 
that  a  solution  to  the  mixed  problem  will  exist  which  satisfies  71  =  7^  and  72  =  T2> 
concurrently.  In  fact,  numerical  results  have  suggested  that  there  is  some  limit  of 
performance  in  this  region.  Since  no  analytical  approach  has  been  devised  thus 
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far  to  determine  the  existence  or  non-existence  of  controllers,  numerical  studies  are 
required  to  determine  where  controllers  can  be  found. 


8.2  Fixed-order  Solutions 


8.2.1  State  Space  Formulation.  Thus  far,  the  order  of  the  controller  has 
been  free,  but  for  practical  design  problems  it  is  necessary  to  fix  the  controller  order. 
This  section  will  develop  the  fixed-order  problem  and  determine  chuacteristics  of  the 
solutions.  Unfortunately,  with  a  fixed-order  controller,  it  is  no  longer  possible  to  use 
the  Youla  parametrization  to  parametrize  the  problem  over  a  convex  set.  However, 
conditions  can  be  derived  which  must  be  satisfied  for  an  extremal  using  the  first 
order  necesseiry  conditions  of  a  particular  Lagrzingian. 


Returning  to  the  system  in  Figure  8.3,  the  state  space  of  P  is  formed  by  wrap¬ 
ping  the  stable  weights  from  the  H2  problem  from  w  to  z  and  the  stable  weights 
of  the  Hoo  problems  from  di  to  'i  around  the  system  G  resulting  in  the  augmented 
plant 


P  = 


A 

K 

By, 

By 

Co, 

Deidi 

•••  Doxdnoo 

Doxv, 

Do,y 

^«»oo 

■^ei»oo  ^1 

••• 

^eiKx>« 

Co 

Dodx 

8 

N 

Dow 

Dzu 

Cy 

Hyd, 

Dyy, 

Dyy 

(8.14) 


where  [*]  are  the  matrices  associated  with  the  system  augmented  by  the  H2  and  Hgo 
weights.  The  order  of  the  individual  H2  and  Hoo  problems  will  generally  be  less  than 
that  of  P,  since  P  incorporates  all  the  H2  and  Hoo  weighting  states.  The  state  space 
equations  of  the  H2  and  Hoo  problems  can  be  written  as 
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SB]  =  A2X2  +  Bu,W  -f-  Bu,U 

(8.15) 

Z  =  CzX2  +  DtvnW  + 

(8.16) 

y  —  C'yj®2  +  ByuiW  -t-  Byutt 

(8.17) 

®oo,-  “  AooiXooi  Bjfdi  -)-  Bft^.ii 

(8.18) 

Ci  =  CeiXooi  +  Dtdidi  +  De^U 

(8.19) 

y  =  Cy^i^OOi  +  Dydidi  +  Dy^U 

(8.20) 

where  23  is  the  state  vector  for  the  underlying  H2  problem  and  Xooi  state 

vectors  for  the  underlying  Boo  problems. 

The  mixed  B2/B00  problem  is:  Find  a  controller  K(8)  which  satisfies 

inf  .  1|T^||2  subject  to  ||Tedil|oo  <  7*>  »  =  1,2, . . 

KHaotlxzing 

•  ,  ^00 

where 

Tzw  —  Cx{^8l  —  A2) 

(8.21) 

Tedi  =  Cei{sl  —  Aooi)~^Bdi  +  Vedi 

(8.22) 

are  the  closed-loop  transfer  functions  from  w  to  z  and  di  to  e,-, 

respectively.  The 

various  matrices  in  (8.21)  and  (8.22)  will  be  defined  shortly. 

To  solve  this  problem  the  following  assumptions  are  made; 

i.  Dgn  =  0 

ii.  Dyu  =  0 
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iii.  stabilizable,  {Cy2,Ai)  detectable 

iv.  full  rank,  Dyu,D^  full  rank 

1 

At  -  ju>I  Buj 


C, 


D, 


has  full  column  rank  for  all  w 


VI. 


Aj  —  jul 


has  full  row  rank  for  all  u 

/  I 

/y2  ^yW 

The  rationale  for  these  assumptions  is  the  same  as  given  in  Section  5.1. 


As  in  the  single  constraint  problem,  D^uDcD^  must  be  identically  zero  for  a 
finite  two-norm  of  to  exist;  condition  iv  then  implies  Dc  =  0.  Thus,  consider  the 
controller  K(s)  in  state  space  form 


ic  =  AtXc  +  BeV 
U  =  CcXc 


(8.23) 

(8.24) 


Closing  the  loop  of  our  system  we  get 


where 


Xj 

=  ^3X2 

+ 

z 

=  C,X2 

Xooj 

~  •AoojXooj 

+ 

B^di 

11 

P 

X 

8 

+ 

V^di 

X2  = 


Xooi  — 


®a 

®c 

®OOi 

®c 


(8.25) 


(8.26) 


(8.27) 
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1^2 

•^^OOt 


Ba, 

C, 

C., 

“^edi 


At  Ce 

BeOy^  Ac 

“ 

•^OOi  ^UoOf  ' 

.  BcC,^,  Ac 

BcDy^ 

Ba, 

BcDyai 

[c,  D^Cc] 

[Cc,  D^Cc] 

Dca, 


(8.28) 

(8.29) 

(8.30) 

(8.31) 

(8.32) 

(8.33) 

(8.34) 


8.2.2  The  Lagrangian  and  Necessary  Conditions.  The  mixed  H2IH0C  prob¬ 
lem  is  now  to  determine  a  K(8)  such  that: 

i.  As  and  Aooi  are  stable  for  all  i 
ii*  lireefclloo  £  7*  for  some  given  set  of  7^  >  7. 
iii-  ll^nvlli  is  minimized. 

Extending  Theorem  5.2.1  to  the  multiple  Hao  constraint  case,  one  obtains  the 
following. 

Theorem  8.2.1  Let  {Ac,  Be,  Ce)  be  given  and  assume  there  exist  a  set  of  solutions 
Qooi  =  Q'Li  ^  0  satisfying 

A^iQco,+Qoo,Al,HQeo,Cl+Ba,T^)RT\Qeofil+Ba,1^^^  =  0  (8.35) 
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for  all  i,  where  Ri  =  (7?/  —  >  0.  Then,  for  each  i,  the  following  are 

eguivalent: 

*•  {'A)Oi,Bdi)  ia  atabUizable 
tt.  Aooi  ”  stable 
Hi.  Ai  is  stable. 

Moreover,  if  i,  ii,  and  Hi  hold,  then  the  following  are  true: 
iv.  ||r«i,.lloo  <  7t  for  all  i 

V.  the  two-norm  of  the  transfer  function  is  given  by 

||r^||5  =  lr(C,erffl  = 

where  =  Q2  >  0  id  the  solution  to  the  Lyapunov  equation 

A3Q2  +  QaA^  +  =  0 

vi.  all  reed  symmetric  solutions  Q„>i  of  (8. 35)  are  positive  semidefinite  for  all  i 

vii.  there  exists  a  unique  minimal  solution  Qoat  to  (8.35)  in  the  class  of  real  sym¬ 
metric  solutions  for  each  i 

via.  Qooi  ore  the  minimcd  solutions  of  (8.35)  iff 

+  Q«,cjier‘c„)i  <  o/ora/ij 

«.  i|r.*iu  <  (<)  n  +  Q^ciRT'c.,)]  <  (<)o 

for  all  j,  where  are  the  minimal  solutions  to  (8.35)  for  each  i. 

Proof:  This  is  an  extension  of  Theorem  5.2.1  for  multiple  Hoo  constraints.  ■ 

Using  Theorem  8.2.1,  the  problem  cmi  be  restated  as:  Determine  the  K(s) 
which  minimizes 

J(^,  B„,  Ce)  =  tr[QaCfC,]  (8.36) 
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where  is  the  real,  symmetric,  positive  semideiiiute  solution  to 


(8.37) 


and  such  that 


=  0  (8.38) 


has  a  real,  symmetric,  positive  semideiinite  solution  ^00,  for  each  t.  To  solve  this 
minimization  problem  with  equality  constraints,  a  Lagrange  multiplier  approach  is 
used.  The  Lagrangian  is 

fipo 

+  +  (<5-<  + 

*=1 

+  Bi,Bl]yi}  (8.39) 

where  X  and  are  symmetric  Lagrange  multiplier  matrices.  The  resulting  first 
order  necessary  conditions  are 

^  -  Xl2Qi2  +  X2Q2  +  Y^,^Q^+Y,Q,^=0  (8.40) 

+  X^BcVi  +  Y^.QaiCy^ 

+  +  Y,By^  +  +  Y,Ql^)ClMi 

+  +  Y2Q,,)CfD'^Mi  =  0  (8.41) 

=  B^XiQi2  +  B^Xi2Q2  +  ^2Qi2  +  RiCcQ2  +  B^^Yi^Qabi 

+  BZ„Yx2iQhi  +  B^QoiYliQalH  +  Rl[biQaiYl3iQbi  +  abfY^.Q  abi 
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dC 

dX 

dC 

dQi 

dC 

dyi 


dc 

9Qeoi 


where 


+  +  lUti^eQ^yUiQhi  +  RbiCeQbiy^iQbi 

+  RbiCeQ^yiiQabi  +  RkiCcQbiy^.Qabi 

+  PiiiyiiQcjH  +  yi2iQbi)  +  P2i{yniQabi  +  y2Qbi)  =  o  (8.42) 

A2Q2  +  Q2y^  +  B^Bl  =  0  (8.43) 

A^X  +  XAi  +  CfC,  =  0  (8.44) 


Aoo^Q^,  +  Qoo^Al,  +  (Qoo^cl  +  +  B^Tf^f 

+  BdiBl  =  0  (8.45) 

(>u., + +  Qo.filR^^c^fyi 

+  y<(Ax.,  +  +  QoofilR^^Ce,)  =  0  (8.46) 


Mi  =  Rr^D^Dl^  (8-47) 

A,  =  Dl^RT^D^Bl  (8.48) 


(8.49) 

Q2  = 

Ql  Qi2 

Qi2  Qt 

(8.50) 

X  = 

1  1 

1 _ - _ 1 

(8.51) 

Qooi  — 

4 

<y  ^ 

1 _ J 

(8.52) 
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yi  = 


Yu  Y,u 

Y^u  Yu  J 


(8.53) 


Bu.Bl 


Bu 


BcDy^ 


qT  jyT  qT 

^yw^c 


Vr  FijSj 

B,V,BJ 


(8.54) 


+ ml  = 

Ba, 

{Tf^Si'V^  + 1) 

Bl  Dl^Bj 

BcD^ 

Kk  VauB^ 
[BcVl  BM^BJ  \ 


(8.55) 


CfC,  = 


CJ 


C, 


Ri  RuCc 

/^TdT  fT  d  n 
Uc  ni2 


(8.56) 


ClflT'C.,  = 


C^Dl^  j 


K 


-1 


Gei  DeuiCc 


Roi  RabiCc 


(8.57) 


As  in  the  single  constraint  case,  these  necessary  conditions  have  not  been  solved 
analytically  but  do  provide  some  insight  into  the  nature  of  the  solution.  In  particular, 
(8.46)  implies  that  either  =  0  or  {A^i-^BdiT^i^Ri^Cei+QooiC^Ri^Cei)is  neutrally 
stable  for  all  t.  The  former  condition  means  the  solution  is  off  the  boundary  of  the 
corresponding  Hoo  constraint,  and  the  latter  condition  implies  the  solution  lies  on  the 
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boundary  of  the  corresponding  Hoa  constraint,  and  Qooi  is  the  neutrally  stabilizing 
solution  for  that  Hoo  Riccati  equation.  This  relation  will  be  used  to  develop  the 
solution  to  the  problem. 

8.2.3  Hi  Order  or  Greater  Solution.  The  order  of  the  controller,  Hcj  is 
assumed  to  be  fixed  at  an  order  greater  than  or  equal  to  that  of  the  underlying 
Hi  problem,  nj,  and  the  mixed  Hi  j Hoo  problem  is  solved.  Since  Uc  >  n2,  the 
unique  optimal  controller  Ki^^  is  admissible  and  the  associated  Hoo  problems  achieve 
infinity- norms  of  7^  with  this  controller.  Thus,  for  the  fixed-order  mixed  Hi/ Hoo 
problem  with  7i  >  7^  for  all  t,  the  optimal  mixed  controller  is  simply  the  Hi  optimal 
controller.  Similarly,  no  controller  of  any  order  exists  which  can  reduce  7i  below  the 
level  of  an  optimal  Hoo  controller,  7^;  therefore,  for  the  mixed  Hi f  Hoo  problem,  no 
solution  exists  if  any  7*  <  7^.  As  was  discussed  at  the  end  of  Section  8.1,  a  region 
where  solutions  do  not  exist  can  exist  inside  Region  1.  Currently,  this  area  can  only 
be  determined  numerically. 

To  simplify  the  discussion,  for  the  remainder  of  this  section  it  will  be  assumed 
that  there  are  only  two  active  Hoo  constraints.  From  the  first  order  necesseiry  con¬ 
ditions,  the  following  theorem  can  be  developed. 

Theorem  8.2.2  Assume  Ue  is  fixed  to  a  value  greater  than  or  equal  to  nj  and 
Uoo  =  2.  Then  the  following  hold: 

»•  if 'll  >  7i  and'fi  >  72,  the  solution  to  the  mixed  Hi /Hoo  problem  exists  and 
i^Ki^ 

ii.  */7i  <  7i  or  72  <  72,  and  a  solution  to  the  mixed  Hi/Hoo  problem  exists,  it 
will  satisfy  at  least  one  of  the  Hoo  constraints  with  equality. 

Proof: 

i.  Since  the  global  optimal  Ki„^t  admissible,  it  is  the  solution. 
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ii.  Assume  the  solution  is  off  both  boundaries  (i.  e.,  neither  constraint  is  satisfied 
\rith  equality).  This  implies  =  0  and  the  Lagrangian  (8.39)  reduces 

to 

£  =  tr[Q,CjC.]  +  tr{[AiQi  +  Q7AI  +  (8.58) 

From  Lemma  1  in  [10],  the  only  controller  which  satisfies  the  first  order  nec¬ 
essary  conditions  for  a  minimum  of  (8.58)  is  the  unique  A'2^,.  However,  this 
solution  lies  outside  the  admissible  region;  thus,  a  contradiction.  Therefore  the 
optimal  solution  satisfies  at  least  one  of  the  Hoo  constraints  with  equality. 


Notice,  inside  Region  I,  we  cannot  clmm  that  both  constraints  will  be  satisfied 
with  equality  as  was  true  in  the  single  constraint  problem.  While  Theorem  8.2.2  does 
not  fuUy  characterize  the  solution  to  the  fixed-order  mixed  problem  unth  multiple 
constraints,  it  does  provide  insight  into  methods  of  solving  the  problem.  For  a 
strictly  sub-optimal  solution,  the  problem  can  be  split  into  two  problems,  one  with 
an  equality  constraint  on  the  first  constraint  and  an  inequality  constraint  on  the 
second,  and  vice  versa.  The  solution  will  then  be  the  controller  which  minimizes  the 
two-norm  of  H2  problem,  while  satisfying  both  constraints. 

However,  if  super-optimal  solutions  are  acceptable  (i.  e.,  solutions  which  do 
not  necessarily  satisfy  one  or  both  of  the  constraints,  but  are  within  some  tolerance  of 
satisfying  them),  both  constraints  can  be  appended  to  the  H2  problem  as  minimum 
distance  constraints  such  ss  the  square  of  the  error  &om  equality.  The  solution 
to  this  problem  will  be  a  fixed-order  controller  which  is  minimum  distance  in  a 
two-norm  sense  from  the  optimal.  Since  K2„^  is  always  in  some  neighborhood  of 
the  global  optimal  (unconstrained  order),  a  solution  to  the  fixed-order  problem, 
with  order  greater  than  or  equal  to  na,  is  guaranteed  to  exist.  The  uniqueness 
of  the  solution,  however,  is  not  guaranteed.  The  super-optimal  approach  has  been 
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successfully  applied  to  the  multiple  constraint  mixed  problem,  as  reported  by  Ullauri, 
ei  al  [63]. 

Finally,  the  constraints  can  both  be  appended  to  the  objective  as  inequality 
constraints.  While  this  is  easier  to  implement  than  a  one  equahty/one  inequaUty 
constraint  method,  it  can  lead  to  numerical  difficulties  if  the  region  of  convergence 
is  highly  non-convex.  In  practice,  this  has  not  been  found  to  be  a  problem. 


8.S  NumericaJ  Solution 

Two  approaches  have  been  developed  to  compute  controllers  which  solve  the 
mixed  /fj/ffoo  problem  for  multiple  constraints.  The  first  method,  called  the  Grid 
Method,  computes  the  set  of  controllers  which  satisfy  the  Hoo  constraints  in  the 
region  of  interest.  This  is  accomphshed  by  holding  all  but  one  constraint  constant  and 
varying  the  remaining  constraint.  The  second  method,  or  Direct  Method,  attempts  to 
simultaneously  reduce  all  the  Hoo  constraicts.  For  the  remainder  of  the  discussion 
it  will  be  assumed  that  there  are  only  two  Hoo  constraints.  The  results  can  be 
extended  as  necessary  to  handle  luger  constraint  sets.  Both  methods  are  based  on 
the  inequality  constraint  program 


min 

KttabUixing 


< 


subject  to 

l|oo  —  7l  ^  0 
ll^edjlioo  ys  ^  0 


(8.59) 


However,  both  methods  could  be  modified  for  equality  constraints  if  desired. 


S.S.i  Grid  Method.  The  grid  method  consists  of  solving  a  series  of  mixed 
problems  by  holding  one  Hoo  constrjiint  constant  and  reducing  the  second.  Once 
the  optimal  curve  has  been  determined,  the  first  constraint  is  decremented  and  the 
process  is  repeated.  The  initial  controllers  for  the  method  are  determined  by  solving 
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the  two  single  constraint  mixed  HifHoo  problems  to  define  the  region  of  interest. 
The  process  results  in  a  surface  defined  by  o  versus  71  versus  72.  An  example  of 
a  surface  generated  using  the  grid  method  is  given  in  Figure  8.10.  The  values  of 
7i  and  72  corresponding  to  the  optimal  H2  solution  is  denoted  in  the  figure,  and 
the  boundaries  extending  from  the  optimal  H2  point  are  the  results  from  the  mixed 
H2/\\Tedi\\fM  and  the  /f2/||re<j,|loo  optimal  control  problems. 
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8.S.2  Direct  Method.  As  waa  discussed  in  the  introduction  to  this  chapter, 
design  objectives  are  often  stated  as  constraints.  Since  the  design  objectives  ue 
often  limited  to  one  region  of  the  constraint  hyperplane,  one  approach  to  synthesizing 
a  controller  would  be  drive  all  ffoo  constraints  concurrently  to  the  desired  region 
without  computing  the  entire  grid  described  in  the  previous  approach.  The  direct 
method  is  an  iterative  approach  where  all  the  constraints  are  decremented  from  some 
initial  point  and  a  solution  is  found.  The  process  continues  until  all  the  constraints 
are  in  the  desired  region. 

For  the  two-constraint  problem,  the  process  used  in  this  approach  is  to  begin 
at  the  optimal  H2  controller  and  simultaneously  reduce  71  and  72  until  a  controller  is 
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found  which  meets  both  objectives.  This  results  in  a  controller  of  fixed-order  which 
meets  both  the  Hoo  constraints  and  has  the  smallest  two-norm  for  the  H2  transfer 
function.  An  advantage  of  the  direct  method  is  that  the  initizd  controller  can  be  cho¬ 
sen  as  any  stabilising  controller  with  order  greater  than  or  equal  to  112-  Numerically, 
the  direct  method  has  been  found  to  work  better  in  the  neighborhood  of  7.  than 
the  grid  method.  One  reason  for  this  is  the  direct  method  approaches  the  minimum 
point  from  a  better  conditioned  portion  of  the  curve.  The  grid  method  attempts 
to  track  the  solution  along  a  minimum  7  curve  and  is  generally  less  numerically 
well  conditioned.  Once  a  controller  is  found  via  the  direct  method  which  satisfies 
the  design  objectives,  a  reduced  size  grid  approach  can  be  used  to  deternaine  design 
trade-offs  in  the  admissible  region. 

8.4  SISO  F-16  Example 

The  SISO  F-16  longitudinal  controller  design  from  Chapter  V  is  used  to  demon¬ 
strate  the  multiple  Hoo  constraint  method.  This  example  demonstrates  the  applica¬ 
tion  of  the  grid  and  direct  methods  for  finding  solutions  to  multiple-constraint  mixed 
problems.  However,  it  is  not  intended  as  an  in-depth  analysis  of  a  controller  design 
with  all  trade-offs  explored.  A  source  for  such  an  exploration  is  [63]. 

Recall  that  the  problem  is  to  design  a  normal  acceleration  tracker  which  also 
has  good  noise  rejection  properties  and  meirgins.  In  the  previous  example,  the  H2 
portion  of  the  mixed  control  design  was  used  to  minimize  response  to  noise,  regu¬ 
late  the  states,  and  limit  control  usage.  The  Hoo  constraint  was  a  sensitivity  model 
matching  problem  designed  to  achieve  the  performance  objective  and  provide  ac¬ 
ceptable  vector  margins.  As  was  seen  in  the  example,  there  was  a  trade-off  between 
the  margins  and  the  performance  as  the  solution  approached  an  acceptable  tracker. 
To  exploit  this  trade-off,  a  second  Hoo  constraint  is  appended  to  improve  margins. 
Thus,  the  problem  will  be  an  LQG  design  with  a  weighted  input  complementary 
constraint  to  recover  margins  and  weighted  output  sensitivity  constraint  to  improve 
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performance.  Since  this  is  a  SISO  plant,  the  margins  and  performance  at  the  input 
and  output  of  the  plant  ue  the  same;  however,  the  methodology  which  is  presented 
here  can  be  applied  to  a  MIMO  plant  to  recover  acceptable  margins  and  performance 
at  both  ends  of  the  plant.  See  [63]  for  a  MIMO  example  of  the  multiple- constraint 
mixed  optimization. 

8.4.1  Problem  Setup.  The  .^3  problem  is  the  same  one  defined  in  the  F- 16 
example  in  Section  6.2.4.  The  Hoo  constraints  consist  of  the  same  transfer  functions 
used  in  the  Hi/p  example  in  Section  7.3.1. 1,  except  the  constraints  will  be  treated 
individually.  Thus,  will  be  the  model  matching  input  complementary  sensitivity 
which  is  used  to  provide  a  measure  of  robust  stability.  The  second  constraint  {Tedj )  is 
an  output  sensitivity  model  matching  problem  which  provides  a  measure  of  nominal 
performance. 

The  objective  is  to  concurrently: 

i.  reduce  the  value  of  llTecf^Hao  bdow  1  to  guarantee  robust  stability  to  expected 
perturbations 

ii.  reduce  the  value  of  ||Te,^||oo  to  as  low  a  value  as  possible  for  nominal  perfor- 
maince 

iii.  minimize  HTx^Ijs  to  provide  noise  rejection,  output  regidation,  and  limit  ::ontrol 
usage. 

The  Hi  and  the  Tedj  matrices  are  the  same  as  the  Hi  and  Hoo  matrices  in 
the  example  in  the  Sections  6.2.4  and  6.2.2,  respectively.  The  weighting  on  the 
complementary  sensitivity  is  selected  as  a  high-pass  filter  and  is  given  by 

50(s  -h  100) 

*  a  -h  10000 
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The  matrices  associated  with  the  complementary  sensitivity  constraint  Tedx 


-1.491 

0.996 

-0.188 

0 

0 

9.753 

-0.960 

-19.04 

0 

0 

0 

0 

-20.0 

0 

0 

35.264 

-0.334 

-4.367 

-40.0 

0 

-35.264 

0.334 

4.367 

80.0 

-10000.0 

0 

0 

0 

0 

0 

•®Uao,  — 

20.0 

0 

0 

0 

0 

=  [  -1763.2  16.7  218.35  4000.0  -495000.0 
=  [  -35.264  0.334  4.367  80.0  0 

=  [0]  =  [0]  Dyd,  =  [1.0]  Dy^  =  [0] 


(8.61) 


(8.62) 


(8.63) 

(8.64) 

(8.65) 


8.4.2  ReauHa.  A  controller  order  of  four  was  selected  so  the  results  could 
be  directly  compared  to  those  of  the  example  in  Section  6.2.  The  problem  was  ap¬ 
proached  by  first  solving  the  single  constraint  problems  Hz/WTedi  ||oo  and  H2/\\Tedi  Hoo- 
The  results  of  these  two  problems  defined  the  optimal  single  constraint  curves  in 
Figures  8.11-8.13.  AdditioneiUy,  the  problems  defined  the  constraint  plane  region  in 
Figure  8.14,  where  a  trade-off  could  be  made  between  robust  stability  and  nominal 
performance.  Of  particular  interest  in  Figure  8.14  is  that  there  is  no  real  trade-off 
tmtil  7a  is  reduced  below  60000.  However,  for  our  particular  problem,  we  are  inter¬ 
ested  in  the  region  close  to  7^  and  7,.  Thus,  a  direct  approach  was  used  to  minimize 
both  constraints  concurrently.  The  result  of  this  search  wris  a  controller  that  yields 
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Figure  8.11.  F-16,  H^l^TediWoo  ot  versus  71  curve 

7i  =  0.861,  7j  =  1.78,  and  a  =  0.411.  This  controller  produced  the  lowest  values  of 
7i  possible  using  the  available  numerical  methods. 

Now  that  the  minimum  point  has  been  determined,  it  is  desired  to  find  the 
trade>ofF  of  71 , 73,  and  a  that  can  be  made  in  the  neighborhood  of  the  minimum  point. 
Thus,  a  grid  method  was  used.  The  initial  controller  was  the  optimal  H^I\\Ttdi\\oo 
controller  corresponding  to  73  =  200.  This  resulted  in  73  =  9.37.  The  grid  was 
generated  by  first  fixing  the  value  of  73  and  reducing  the  value  of  71.  The  value  of  73 
was  then  decremented  and  the  process  was  repeated.  The  values  of  71  used  were  200, 
100,  50,  20, 10,  5,  2,  and  1.  To  complete  the  grid,  the  roles  of  71  and  73  were  reversed, 
and  another  grid  was  generated  using  73  values  of  8,  6,  4,  2,  1,  and  0.5.  The  surface 
which  resulted  is  given  in  Figure  8.15.  The  shape  of  the  surface  is  as  expected,  with 
an  obvious  trade-off  between  performance  eind  the  constraints.  Since  our  first 
objective  is  to  obtain  robust  stability,  we  can  accept  any  solution  which  results  in 
7i  <  1.  Figure  8.16  is  the  projection  of  the  mixed  surface  in  the  constraint  plwe. 
Any  solution  in  the  acceptable  region  will  guareintee  robust  stability.  Therefore,  the 
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Figure  8.12.  F-16,  .ffa/||3e<ij||oo  «  versus  7j  curve 


Figure  8.13.  F-16,  ot  versus  72  curve,  expanded 


Figure  8.14.  F-16,  constraiiit  plane  solution  regions 


problem  reduces  to  a  trade-off  analysis  between  7a  and  a.  If  it  is  desired,  the  grid 
can  be  further  refined  in  the  acceptable  region  to  determine  the  best  solution. 

One  interesting  result  of  this  particular  problem  is  that  the  controller  with 
the  best  robust  stability  (a  =  0.411, 71  =  0.86,73  =  1.78)  yields  a  different  con¬ 
troller  from  the  best  one  found  in  the  single  constraint  problem  given  in  Section  6.2 
(a  =  0.409,71  =  1.02,7a  =  1.49).  The  time  responses  for  both  controllers  are  given 
in  Figure  8.17.  Notice  that  we  give  up  some  nominal  performance  in  order  to  increase 
stability  robustness.  If  we  desire,  the  71  (robust  stability)  constraint  could  be  relaxed 
to  7i  <  1.0  and  the  minimum  73  can  be  determined.  In  fact,  71  =  1.02  for  the  single 
constraint  controller  nearly  meets  our  robust  stability  bound.  Thus,  for  practical 
purposes,  the  73  =  1.49  controller  achieves  our  desired  robustness  bounds.  Finally, 
the  vector  margins  for  the  multiple  constraint  controller  are  [—7.55  7.31]d^  gain 
margin  and  33.8°  phase  margin.  These  are  lower  than  the  margins  resulting  from  the 
single  constraint  controller  which  are  [—5.9  10.2i\dB  gain  margin  and  40.7°  phase 
mar^.  Thus,  while  the  multiple  constraint  controller  has  the  best  robustness  to  the 
modeled  perturbations,  it  has  less  robustness  to  independent  gain  and  phase  varia- 
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Figote  8.17.  F-16,  HijHoo  and  ^j/multiple  Hoo  controllers,  response  to  unit  nor¬ 

mal  acceleration  step 

tions.  Since  the  single  constraint  controller  achieves  our  robustness  bound,  and  also 
provides  better  performance  and  margins,  it  is  a  better  choice  for  implementation. 

The  trade-off  in  performance  to  achieve  our  robust  stability  bound  is  not  sig^' : 
icant  for  this  problem.  This  is  not  a  surpruing  result  due  to  the  relationship  between 
the  input  complementary  sensitivity  and  the  output  sensitivity  for  a  SISO  system. 
However,  this  will  not  be  true  for  all  problems.  In  particular,  a  MIMO  system  can 
result  in  constraints  on  the  input  sensitivity  and  complementary  sensitivity  as  well 
as  the  output  sensitivity  and  complementary  sensitivity.  In  addition,  there  may  be 
constraints  on  additive  perturbations  and  control  usage.  Thus,  a  more  significamt 
trade-off  is  expected,  in  general,  between  the  different  objectives. 

8.5  Summary 

This  chapter  extended  the  Hj/Hoo  control  problem  to  include  multiple  Hgo 
constraints.  The  optimal  solution  for  this  problem  was  shown  to  be  unique.  Further, 
a  set  of  relationships  were  developed  between  the  level  of  the  constraints  and  which 
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constraints  must  satisfied  with  equality  for  an  optimal  solution.  Fixed-order  con¬ 
trollers  were  addressed  next,  and  it  was  shown  that  the  solution  is  either  K2^  or  it 
must  satisfy  at  least  one  constraint  with  equality.  Based  on  this  result,  two  numerical 
approaches  were  developed.  A  grid  method  can  be  used  to  determine  the  trade-oif 
available  between  the  constraints.  A  direct  approach  can  be  used  if  a  particular  level 
of  the  constraints  is  desired.  Finally,  an  F-16  longitudinal  control  design  example 
was  used  to  demonstrate  both  numerical  methods.  It  clearly  showed  the  various 
trade-offs  available  to  the  designer  between  robust  stability,  nominal  performance, 
and  margins. 
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IX.  Mixed  H^/Li  and  H^/Hoo/i^/Li  Optimal  Control 

Thus  far,  the  problem  we  have  examined  is  a  convex  program  consisting  of 
an  H2  objective  function  with  a  finite  set  of  Hoo  constraints.  This  problem  can  be 
extended  to  include  any  finite  set  of  convex  constraints.  In  particular,  this  chapter 
will  develop  a  methodology  to  include  an  Li  constraint.  Once  again,  the  uniqueness 
of  the  optimal  (order-free)  controller  will  be  shown.  Further,  a  numerical  approach 
based  on  an  equivalent  discrete- time  system  will  be  suggested.  To  conclude  this 
discussion,  all  the  constraints  discussed  in  this  dissertation  will  be  combined  into  a 
multiple-constraint  mixed  problem. 

9. 1  Mixed  Hi/Lx  Optimization 

Often  the  control  engineer  is  faced  with  requirements  which  can  include  limits 
on  control  surface  deflections,  maximum  positive  and  negative  accelerations,  limits  on 
angles  of  rotation,  and  so  forth.  In  the  mixed  HifHoo  problem,  these  limitations  have 
been  included  as  bounded  energy  limitations.  While  this  often  works  adequately,  it 
does  not  ensure  that  the  magnitude  limit  will  be  met.  A  better  way  of  incorporating 
these  requirements  is  to  treat  them  directly  as  bounded  magnitude  limitations.  Thus, 
if  we  consider  a  system  with  a  bounded  magnitude  input  r  and  desire  to  place  a  limit 
on  the  worst  case  magnitude  of  the  output  m,  we  can  define  an  induced  operator 
norm  on  the  system  as  ||Tmr||;  which,  for  continuous  systems,  is  just  the  Lx-tlotvo.  of 
the  impulse  response  of  the  transfer  function  from  r  to  m.  For  discrete  systems  it  is 
the  ^i-norm  of  the  pulse  response  of  the  transfer  function. 

There  is  currently  a  great  deal  of  interest  in  developing  control  synthesis  meth¬ 
ods  based  on  the  /i-norm  (for  an  in-depth  examination  of  the  subject,  see  [20]).  In 
this  work,  we  are  not  interested  in  trying  to  solve  an  lx  control  problem;  rather,  we 
are  just  interested  in  adding  an  Lx  or  lx  constrmnt  into  the  framework.  This  is  not 
as  straightforward  as  the  Hoo  constraint  since  there  is  no  convenient  method  of  com- 
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Figiure  9.1.  General  mixed  HifL\  optimization  problem 

putinj  the  Li-norm  of  a  frequency  domain  transfer  function.  However,  we  are  still 
dealing  with  a  normed  constraint;  therefore,  the  problem  remains  convex  and  the 
previous  work  will  hold.  The  fixed-order  approach  will  be  modified  to  compute  the 
/i-norm  of  an  equivalent  discrete  transfer  function.  In  general,  the  problem  should 
be  posed  in  the  discrete  domain  and  both  the  H2  and  ii  problems  solved  there.  One 
reason  for  this  approach  is  that  the  final  implementation  will  usually  be  performed 
in  the  discrete  domain.  Therefore,  a  controller  designed  in  the  continuous  domain 
will  have  to  be  discretized,  which  will  result  in  a  sub-optimal  controller.  However, 
the  discrete  problem  is  beyond  the  scope  of  this  work;  this  section  will  only  cheirac- 
terize  the  optimal  (order-free)  solution  for  the  H2lL\  problem  and  develop  a  hybrid 
algorithm  for  including  an  /i-norm  overbound  on  the  Li  constraint  in  a  frequency 
domain  H2/L1  problem. 

9.1.1  Unifueness  of  the  Optimal  H2/L1  Controller.  Consider  the  general 
control  system  shown  in  Figure  9.1,  where  w  is  a  unit  intensity  white  Gaussian 
noise  input,  r  is  a  bounded  magnitude  input,  and  z  and  m  rire  controlled  (possibly 
fictitious)  outputs  where  it  is  desired  to  minimize  the  energy  of  z  and  the  magnitude 
of  m.  It  is  assumed  that  there  is  no  a  priori  relationship  between  w  and  r  or  z  and 
m.  The  measured  output  is  y  and  the  control  law  is  u  =  K(s)y. 
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The  mixed  HifLi  problem  is  to  design  a  controller  K(8)  such  that  the  transfer 
function  &om  w  to  z  has  minimum  energy  subject  tr  maintaining  the  magnitude  gain 
of  the  transfer  function  from  r  to  m  below  some  predetermined  value  i/.  The  former 
problem  is  an  H2  problem  and  the  constraint  is  an  Li  problem.  As  in  the  H2/H00 
problem,  the  full  plant  P(s)  is  formed  from  some  underlying  plant  6^(s)  augmented 
with  stable  weighting  transfer  functions  on  the  inputs  r  and  w  and  the  outputs  m 
and  z.  Partitioning  P  in  a  similar  fashion  to  the  previous  work,  this  system  can 
reduced  to  two  separate  problems:  the  /f]  problem,  which  is  to  find  an  internally 
stabilizing  controller  K(s)  which  minimizes  ||Txw||2  where 

Zw  =  P^u,  +  P^K  (7  -  P^K)-^  P^  (9.1) 

and  the  Li  problem,  which  is  to  find  an  internally  stabilizing  controller  K(s)  which 
satisfies  ||Tn,,||i  <  1/  for  some  t/  where 

Tmr  =  Pmr  +  PmuK  (I  -  PyuK)'^  Pyr  (9.2) 


As  before,  it  is  assumed  that  is  strictly  proper  and  thus  has  a  finite  two- 
norm.  The  mixed  Tfa/i/i  problem  can  be  stated  as:  find  a  stabilizing  controller 
K(8)  which  minimizes  the  two-norm  of  and  satisfies  the  constraint  that  the  one- 
norm  of  Tmr  is  less  than  or  equal  to  some  fixed  v.  This  mathematical  programming 
problem  can  be  transformed  into  a  convex  programming  problem  through  the  use  of 
the  Youla  parametrization.  The  convex  program  is 


miJT,,  +  T2,QT2,\\2 

subject  to 


(9.3) 


where  Tj,  are  defined  in  a  similar  method  as  in  Section  4.2.  Define  u  as  the 
mifiittinni  u  for  which  a  controller  exists  and  v*  as  the  value  of  v  when  the  loop  is 
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closed  vrith  the  optimal  (order-free)  mixed  controller.  Also,  define  t/  as  the  value  of 
u  when  the  loop  is  closed  with  . 

Theorem  9.1.1  Let  u  >  v  be  given.  The  controller  which  satisfies  the  convex  pro¬ 
gram  (9.S)  is  unique.  Furthermore,  the  following  hold: 

i.  if  V  '>v,  the  controller  is  the  optimal  controller 

ii.  If  V  <V ,  u*  =  u  at  the  optimal  (i.  e.,  the  solution  will  satisfy  the  Li  constraint 
with  equality). 

Proof;  The  proof  follows  directly  from  the  proof  of  Theorem  4.2.1.  ■ 

In  general,  the  optimal  (order-free)  controller  will  be  unique  for  any  convex 
constraint.  In  fact,  this  result  is  easily  extended  to  include  any  finite  set  of  convex 
constraints. 

9.1.2  Fixed-Order  Controllers — Numerical  Approach.  Assume  the  con¬ 
troller  order  is  fixed  at  a  value  greater  than  or  equal  to  the  order  of  the  H2  order. 
The  mixed  H2IL1  problem  can  be  solved  numeric;dly  using  an  approach  similar  to 
that  used  in  the  mixed  H2/H00  problem.  There  will  be  no  attempt  to  characterize 
the  nature  of  the  fixed-order  controller,*  rather,  an  algorithm  will  be  developed  which 
attempts  to  find  a  fixed-order  controller  in  a  neighborhood  of  the  optimal  (order- 
free)  controller.  As  before,  the  region  of  interest  for  this  problem  is  v<  v  <V  since, 
if  */  >  F  the  optimal  controller  is  and  ii  v  <v,  no  solution  exists. 

Define  the  program 

min  IITnvIls 

KiiahUinng"  " 

'  subject  to  (9*^) 

,  ||r,nr||l-l/<0 

Program  (9.4)  can  be  minimised  using  the  SQP  routine  described  in  Chapter 
VI.  The  algorithm  will  be  identical  to  the  previous  results  with  the  exception  of 
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the  calculation  of  the  constraint  and  its  gradient.  As  was  discussed  in  Section  2.3.3, 
there  is  no  convenient  way  of  computing  the  Li-norm.  However,  the  ^i-norm  of  an 
equivalent  discrete  system  can  be  computed  to  any  desired  accuracy.  Further,  from 
Theorem  2.3.1,  by  using  an  Euler  approximation  system  of  the  continuous  system,  we 
can  always  insure  that  the  discrete  ^i-norm  will  be  an  upper  bound  to  the  continuous 
Xi-norm. 

To  compute  the  /j-norm,  first  put  the  system  into  an  EAS  discrete  form  us¬ 
ing  the  method  described  in  Section  2.3.3.3.  For  synthesis,  the  time  step  r  in  the 
discretization  is  fixed  based  on  the  bandwidth  of  the  system.  Once  the  equivalent 
discrete  trsmsfer  function  is  determined,  the  ^i-norm  is  determined  using  the  method 
given  in  Section  2.3.3. 2.  The  acceptable  level  of  error  in  the  norm  is  also  used  to 
determine  N,  the  point  where  the  infinite  sum  is  truncated. 

Finally,  the  gradient  of  the  constraint  is  determined  analytically.  The  gradient 
is 


dXi 


d\Z\CEA%BE\  +  \DE\ 


U=o 


d 


dXi 

[E|C'(/-TA)‘rB|  +  |i?| 


dXi 


(9.5) 


(9.6) 


where  {Ae,  Be,  Ce,  Be)  is  the  EAS  equivalent  of  realization  (A,  B,  C,  D)  of  Tmr- 

This  proposed  method  has  not  been  implemented  to  date.  However,  it  would 
appear  to  provide  a  straightforward  approach  to  handling  Li  constraints.  Further 
development  along  these  lines  of  research  are  being  pursued. 


9.2  Ha  Optimization  with  Hoo,  p,  and  Li  Constraints 

To  complete  this  dissertation,  we  will  look  at  how  we  can  put  this  all  together 
solve  an  aircraft  control  problem.  The  various  exogenous  inputs  to  the  system  include 
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Figure  9.2.  General  mixed  Hoo! Itj Lx  optimization  problem 

white  noises  from  wind  disturbances  and  measurement  noises.  In  addition,  there 
are  plant  perturbations  due  to  unmodeled  dynamics  and  aerodynsunic  variations. 
The  primary  design  objective  is  to  ensure  the  system  remains  stable  in  light  of  the 
noises  and  plant  perturbations.  Furthermore,  the  performance  objectives  include 
attenuating  response  to  noise  and  perturbations  and  providing  desired  response  to 
commanded  inputs.  Moreover,  it  is  desired  that  this  performance  remain  at  an 
zu:ceptable  level  in  light  of  the  perturbations  described  above.  Finally,  there  may 
be  some  catastrophic  perturbations,  such  as  the  loss  of  a  control  surface,  which  are 
not  desirable  to  include  in  the  above  objectives.  However,  some  limited  subset  of 
the  stability  and  performance  objectives  must  be  met  in  light  of  these  catastrophic 
perturbations. 

The  above  objectives  can  be  recognized  as  the  robust  stability  and  robust 
performance  problems  defined  in  the  introduction  to  this  dissertation.  Moreover, 
we  have  now  developed  the  necessary  tools  to  handle  a  set  of  these  objectives  in  an 
optimal  fashion.  Consider  the  block  diagram  given  in  Figure  9.2.  Following  the 
standard  notation  from  the  previous  chapters,  w  represents  the  white  noise  inputs, 
d  and  s  are  the  bounded  energy  inputs  and  r  represents  the  bounded  magnitude 
inputs.  The  controlled  outputs  z,  e,  and  v  are  bounded  energy  and  m  is  bounded 
magnitude.  As  before,  no  a  priori  relationship  between  w,  d,  s,  or  r  and  z,  e,  v,  or  m 
is  assumed.  The  problem  can  now  be  stated  as:  Find  the  controller  K  which  solves 
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the  program 


V  { 


a  =  inf  . 

K  stabilizing 

subject  to 


lir^lU  <  7 


l|r..lU<^ 


(9.7) 


Through  the  use  of  the  Youla  parametrization  from  Section  3.1,  the  problem 
can  be  transformed  to  the  convex  program 


a=  mfj|r..  +  r,.Qr3.||, 

subject  to 


P  < 


IITi.  +ri.0T3.|U  <  7 


(9.8) 


where  Tf,  are  associated  with  Tg^,  Ti^  are  associated  with  Tej,  Ti^  are  associated 
with  Tv«,  and  7^,  are  associated  with  Tmr- 


Theorem  9.2.1  Assume  the  convex  program 


V 


0=  kllJ|3’,.  +  J’3.<?r3.||3 

'  subject  to 


[  l|r„  +  ri<?r3,IU<7i 


(9.9) 


where  G  {oo,  1}  and  i  =  1, . . . ,  iV,  is  consistent.  Then  the  Q  E  H3  which  achieves 
the  infimum  is  unique. 

Proof:  From  Lemma  4.1.1,  the  two- norm  is  a  strictly  convex  functional,  therefore, 
from  the  corollary  to  Theorem  9.4.1  [35],  any  solution  to  the  convex  program  (9.9) 
is  unique.  ■ 
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The  characterization  of  where  the  optimal  (order-free)  solution  will  fall  rela¬ 
tive  to  the  constraints  is  complicated  for  this  problem  due  to  the  increased  number 
of  constraints.  However,  the  optimal  solution  must  still  satisfy  the  Kuhn-Tucker 
conditions. 

For  fixed-order  solutions,  both  the  direct  and  grid  methods  from  Chapter  VIII 
can  be  extended  to  include  the  Isurger  set  of  constraints.  As  the  number  of  constraints 
increases,  greater  insight  into  the  desired  objective  bounds  will  be  needed  to  limit 
the  region  of  interest.  In  addition,  the  increased  number  of  constraints  provide  the 
designer  with  more  trade-offs.  Thus,  by  incorporating  Hoo,  li  constraints 

into  the  H2  optimization  problem,  the  designer  can  now  account  for  a  larger  set  of 
stability  and  performance  objectives  in  an  optimal  fashion. 

9.S  Application  of  Mixed  Optimization 

While  this  section  cannot  provide  a  complete  method  for  solving  all  control 
design  problems  using  mixed  optimization,  some  thoughts  on  applications  are  ap¬ 
propriate.  To  begin,  it  is  necessary  to  determine  exactly  which  portion  of  the  mixed 
method  will  be  used  to  handle  each  design  problem  faced.  It  may  turn  out  that  a 
combined  approach  can  be  taken  where  one  problem  is  addressed  by  a  combination 
of  the  objective  and  constraints.  Since  the  H2  problem  is  the  objective  function  it 
is  the  logical  stztrting  point  for  this  discussion. 

Traditionally,  the  H2  problem  is  set  up  to  minimize  the  influence  of  both  low 
zuid  high  frequency  noise.  Additionally,  it  has  been  found  that  tracking  can  often  be 
obtained  by  adding  a  low  frequency  noise  at  the  output  and  minimizing  the  energy 
of  the  output.  While  this  has  some  merits,  the  tracking  problem  czin  be  directly 
approached  by  using  an  Hoo  constraint  or  an  Li  constraint.  Furthermore,  we  saw 
in  the  F-16  problem  that  a  good  output  tracker  also  had  good  low  frequency  noise 
rejection.  Thus,  it  may  be  possible  to  use  the  H2  portion  of  the  mixed  problem 
primarily  to  limit  the  response  of  the  system  to  high  frequency  noise.  Of  course. 
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we  assumed  that  the  problem  is  regular,  so  some  low  frequency  noise  will  be 
necessary. 

The  next  problem  to  attack  is  how  to  achieve  robust  stabihty  2ind  perfor¬ 
mance.  As  we  saw,  ^-synthesis  provides  a  method  for  achieving  the  desired  robust¬ 
ness.  Therefore,  the  expected  perturbations  and  performances  requirements  should 
be  incorporated  into  a  n  constraint.  However,  as  has  been  mentioned  earlier,  there 
may  be  some  perturbations  which  have  a  low  probability  of  occurrence,  but  for  which 
we  desire  some  minimal  level  of  robustness  to.  These  catastrophic  perturbations  can 
be  incorporated  into  the  problem  as  an  Hoo  constraint.  Therefore,  a  trade-off  can 
be  made  between  our  ‘*normal”  capability  and  the  ability  to  handle  catastrophic 
events.  It  should  be  mentioned  that  the  desire  is  not  necessarily  to  design  a  con¬ 
troller  which  provides  for  every  situation,  but  rather  one  which  provides  some  level 
of  stability  and  performance  while  the  catastrophic  event  is  identified  and  the  control 
laws  reconfigured. 

Finally  a  discussion  of  the  level  of  nominal  performance  achieved  throughout 
this  work  is  needed.  Using  Hoa  techniques  we  have  been  able  to  find  controllers 
which  track  better  and  have  better  margins  than  the  LQG  regulator  we  began  with. 
However,  we  have  not  achieved  the  level  of  tracking  performance  desired  in  most 
applications.  In  particular,  we  are  often  given  specifications  on  the  rise  time,  over¬ 
shoot,  and  settling  time  restdting  from  tracking  a  unit  step  input  to  the  system.  All 
of  these  are  inherently  bounded  magnitude  constraints.  Thus,  the  obvious  approach 
to  incorporating  these  constraints  is  to  define  them  as  Ly  transfer  functions  and  ad¬ 
join  them  to  our  optimization  problem.  Therefore,  we  axe  able  to  address  a  number 
of  concerns  of  the  designer  and,  through  the  mixed  approach,  provide 

a  method  of  designing  controllers  by  trading  off  the  various  objectives. 
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X.  Conclusions  and  Recommendations 


10.1  Summary 

This  dissertation  has  characterized  the  mixed  norm  optimization  problem  for 
both  order-free  and  fixed-order  controllers.  The  first  problem  considered  was  the 
general  mixed  H^/Hoo  optimization  problem  for  output  feedback.  It  was  shown  that 
the  problem  can  be  restated  as  a  convex  program  through  application  of  the  Youla 
parametrization  of  all  stabilizing  controllers.  This  form  was  then  used  to  prove  that 
the  optimal  order-free  solution  is  unique.  Furthermore,  through  a  duality  approach, 
the  controller  for  a  special  case  of  the  Hi/ Hoo  problem  was  shown  be  non-rational 
or  infinite  order. 

Due  to  the  real  world  requirement  that  controller  order  be  reduced  to  an  imple- 
mentable  level,  a  fixed-order  solution  was  sought.  For  the  mixed  Hi/Heo  problem,  it 
was  shown  that  optimal  fixed-order  solutions  exist  for  orders  as  low  as  the  Hi  prob¬ 
lem.  Farther,  the  necessary  conditions  for  an  optimal  fixed-order  controller  were 
developed  for  the  nuxed  problem  with  both  a  singular  and  proper  (but  not  necessar¬ 
ily  strictly  proper)  Hoo  constraint.  In  addition,  the  nature  of  the  optimal  fixed-order 
controller  was  characterized  based  on  the  level  of  the  desired  H„  constraint. 

A  numerical  synthesis  method  was  developed  based  on  the  results  of  the  fixed- 
order  solutions.  This  method  is  based  on  the  relationship  of  the  optimal  two-norm 
versus  infinity-norm  curve.  It  has  the  advantage  of  only  requiring  a  regular  Hi 
problem,  and  thus  can  handle  singular  H^o  constraints,  including  those  that  have  as¬ 
sociated  Hamiltonians  with  jw-ajda  zeros.  The  numerical  search  was  based  on  either 
a  Davidon-Fletcher- Powell  or  a  Sequential  Quadratic  Programming  algorithm.  Since 
the  optimal  Hi  solution  is  easily  computed,  it  was  selected  as  a  convenient  initial 
controller.  Both  sub-  and  super-optimal  solutions  can  be  found  using  the  method. 


The  gradient  of  the  two-noim  objective  function  was  derived  from  Lagrangian 


C  =  tr  [(3,CfC.|  +  <r  +  Q,A^  +  B^Bl)x\  (10.1) 

The  gradient  of  the  Hoo  constraint  was  based  either  on  a  central  difference  or 
on  an  analytical  gradient  of  the  associated  maximum  singular  value.  The  sensitivity 
method  resulted  in  more  accurate  gradients  and  therefore  converged  to  solutions 
faster  and  more  accurately.  However,  it  is  limited  due  to  the  piecevnse  continuous 
nature  of  the  Hoo  gradient.  Both  the  DFP  and  SQP  methods  took  significantly 
less  computation  time  than  existing  methods.  Finally,  the  SQP  method  was  able  to 
converge  to  controllers  with  lower  values  of  7  and  required  fewer  iterations  than  the 
DFP  method. 

The  new  numerical  method  was  used  to  demonstrate  the  application  of  the 
mixed  problem  to  a  SISO  F-16  normal  acceleration  control  design  problem.  It  was 
found  that  a  significant  reduction  in  the  infinity-norm  constraint  could  be  made 
with  Uttle  increase  in  the  two-norm.  This  trade-off  allowed  the  mixed  controller  to 
improve  both  stability  robustness  and  tracking  performance  without  suffering  loss  of 
noise  rejection  or  excessive  control  usage. 

The  mixed  problem  was  also  extended  to  include  robust  performance  through 
the  addition  of  a  ft  constraint.  This  was  accomplished  by  substituting  the  mixed 
approach  for  the  last  controller  design  in  a  D-K  iteration.  Using  mixed  ^2/^  opti¬ 
mization,  both  the  robust  stability  and  robust  performance  problems  were  developed. 
The  SISO  F-16  normal  acceleration  control  problem  and  a  MIMO  HIM  AT  longitu¬ 
dinal  control  problem  were  used  to  demonstrate  the  usefulness  of  the  mixed  H2/H 
problem.  In  both  examples,  the  order  of  the  controller  was  reduced  significantly 
below  the  order  resulting  from  a  /i-synthesis  design.  Furthermore,  the  F-16  design 
demonstrated  a  significant  reduction  in  high  frequency  noise  response  and  control 
usage  when  compared  to  the  controller. 
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To  extend  the  class  of  problems  to  which  mixed  optimisation  can  be  apphed, 
multiple  Hoo  constraints  were  incorporated  into  the  Ha/Hoo  problem.  It  was  shown 
through  convex  analysis  that  the  optimal  (order-free)  controller  is  unique.  Further, 
the  necessary  conditions  for  an  optimal  fixed-order  control  controller  were  developed. 
In  particular,  it  was  shown  that  the  optimal  fixed-order  controller  must  satisfy  cer¬ 
tain  conditions  based  on  where  the  intersection  of  the  Hoo  constraints  fall  in  the 
constraint  plzine.  Two  numerical  approaches,  the  grid  and  direct  methods,  were  de¬ 
veloped  to  find  solutions  which  satisfied  design  objectives.  Again,  the  SISO  F-16 
normal  acceleration  problem  was  used  to  demonstrate  the  methods.  The  various 
regions  in  the  constraint  plane  were  found  and  the  direct  method  was  used  to  find  a 
solution  which  satisfied  the  design  objectives.  Moreover,  a  grid  was  produced  in  the 
neighborhood  of  this  solution  to  demonstrate  the  available  trade-offs  which  could  be 
made  between  the  two-norm  and  the  constraints. 

Next,  the  mixed  problem  was  extended  to  include  Li  constraints.  Again,  the 
uniqueness  of  the  optimal  (order-free)  solution  was  shown.  In  fact,  this  result  can  be 
extended  to  any  set  of  convex  constraints  appended  to  the  Ha  problem.  A  numerical 
approach  to  the  Ha/ Li  problem  was  proposed.  It  is  based  on  computing  the  /i-norm 
of  an  equivalent  discrete-time  system. 

Finally,  all  of  the  above  results  have  been  combined  to  form  an  Ha  optimiza¬ 
tion  problem  with  any  finite  set  of  Hoot  constraints.  Such  problems  arise 

often  in  aerospace  applications.  One  particular  exaonple  is  a  robust  performance 
problem  which  also  has  a  robust  stability  objective  due  to  another  potential  catas¬ 
trophic  perturbation.  If  the  catastrophic  perturbation  is  included  in  the  structured 
perturbation,  it  can  limit  the  performance  available  under  “normal”  perturbations. 
Therefore,  it  is  not  desirable  to  include  the  catastrophic  perturbation  into  the  struc¬ 
tured  perturbation  for  the  /t  robust  performance  constraint.  However,  with  the 
mixed  approach,  the  catastrophic  robust  stability  objective  can  be  appended  to  the 
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problem  as  an  additional  Hoo  constraint.  Now  a  trade-off  can  be  made  between 
robust  performance  and  “catastrophic”  robust  stability. 

10.2  RecommendtUions  for  Future  Research 

While  this  dissertation  has  contributed  to  the  understanding  of  mixed  norm 
optimization  problems,  there  still  remains  a  number  of  questions  to  be  answered. 
The  first  of  these  is  what  the  optimal  order  of  a  mixed  controller  is,  and  what  the 
optimal  mixed  curve  looks  like.  While  the  optimal  order  appears  to  be  infinite,  this 
has  not  yet  been  proven  analytically.  This  problem  may  possibly  be  solved  through 
the  operator-theoretic  approach  developed  in  this  work. 

Another  question  which  has  not  been  answered  is  the  uniqueness  of  the  optimal 
fixed-order  controller.  Numerical  results  to  date  tend  to  indicate  the  controller  is 
unique.  However,  due  to  the  lack  of  convexity  of  the  underlying  set,  it  has  not 
been  shown  whether  or  not  the  optimal  fixed-order  solution  is  unique.  Perhaps  the 
application  of  nonconvex  analysis  to  this  problem  will  be  able  to  answer  the  question. 

Thirdly,  the  synthesis  method  proposed  in  this  work  has  not  been  refined  to  the 
point  where  it  is  ready  for  everyday  application.  In  particular,  the  numerical  solution 
has  problems  around  the  knee  of  the  a  versus  7  curve.  The  largest  contributor  to  this 
problem  is  the  nature  of  the  Hqo  constraint.  For  problems  of  interest,  the  gradient  of 
the  Hgo  constraint  is  only  piecewise  continuous;  this  leads  to  the  gradient  being  valid 
in  only  a  small  neighborhood  of  the  nominal  solution.  Thus,  the  step  size  of  the  one 
dimensional  search  must  be  reduced,  resulting  in  an  increased  number  of  iterations 
to  converge  to  a  solution.  Another  problem  is  the  non-uniqueness  of  a  particular 
state  space  realization  of  the  controller  transfer  function.  This  has  been  partially 
overcome  through  the  use  of  the  modal  canonical  form,  but  this  does  not  allow  all 
possible  controller  transfer  functions  (i.  e.,  it  only  allows  controllers  with  first  order 
Jordan  blocks).  Incorporation  of  a  modified  Jordan  form  [60]  should  overcome  this 
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limitation.  Refinement  of  the  numerical  method  is  an  open  problem  which  should 
yield  a  significant  advance  in  optimal  control  synthesis. 

The  fourth  open  area  is  the  Hif  L\  optimization  problem.  While  a  continuous 
approach  to  this  problem  has  been  proposed,  the  appropriate  approach  is  in  the 
discrete  domain.  In  fact,  the  entire  mixed  framework  should  be  rederived  in  the 
discrete  domain.  This  has  the  advantage  of  producing  a  controller  which  can  be 
directly  implemented  by  a  digital  computer  without  adding  the  complicated  and  sub- 
optimal  step  of  discretizing  a  continuous  controller.  This  work  is  currently  underway. 

Finally,  mixed  optimization  with  i?ooi  M)  constraints  needs  to  be 

demonstrated  on  a  realistic  control  design  problem.  As  was  suggested,  a  robust  per¬ 
formance  problem  combined  with  a  catastrophic  robust  stability  objective  would  be 
ideal  for  this.  Further,  the  ever-present  noise  rejection  and  state  regulation  problem 
can  be  incorporated  into  the  H%  problem.  Fin2dly,  the  L\  constraints  can  be  used  to 
enforce  time  domain  constraints,  such  as  control  deflection  and  normal  acceleration 
limits.  Through  such  control  design  examples,  the  flexibility  and  power  of  the  mixed 
optimization  approach  can  be  further  explored  and  refined. 
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Appendix  A.  SISO  F-16  Short  Period  Model 

The  F-16  normal  acceleration  command  control  system  is  modeled  by  a  con¬ 
tinuous,  time-invariant  linear  system  shown  in  Figure  A.l.  The  system  consists  of 
a  two-state  short  period  approximation  of  the  normal  acceleration  command  system 
augmented  with  a  pre-filter  for  the  servo  dynamics  and  a  post-filter  to  model  the 
control  delay.  The  plant  states  are  the  angle  of  attack  (a)  and  the  pitch  rate  (q). 
The  input  is  the  stabilator  deflection  (fe)  and  the  output  is  normal  acceleration  (n^). 
The  plant  (Wp)  is  given  by 
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The  actuator  dynamics  (W«)  are  modeled  as  a  first  order  relation  between  the 
commanded  stabilator  deflection  (^ecm)  actual  deflection  given  by 


Se  =  -20.0fie  +  20.05e 


(A.2) 


A  first  order  Fade  approximation  is  used  for  the  time  delay  {Wj)  and  is  given  by 

d  =  — 40.0d  -f  n. 


=  SO.Od  -  n. 


(A.3) 


where  (»**,,„)  is  the  output  of  the  system. 

A  wind  disturbance  is  modeled  as  an  angle  of  attack  perturbation  by  a  zero- 
mean  white  Gaussian  noise  with  a  strength  of  5.0  x  10~^  rad’-sec.  The  measurement 
is  corrupted  by  zero-mean,  white  Gaussian  noise  of  strength  1.6  x  10~‘  g^-sec.  The 
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Figure  A.l.  F-16  model  block  diagram 

strength  of  the  noises  were  determined  by  tuning  a  linear  quadratic  estimator.  The 
truth  model  for  the  tuning  tind  analysis  includes  a  first  order  Von  Karman  wind 
model  for  the  low  frequency  process  noise  {Ww),  which  entered  the  plant  as  an  alpha 
perturbation  (F),  and  a  high-pass  filter  to  model  the  measurement  noise  {Wm).  These 


models  are  given,  respectively,  as 

x'w  =  —6.7xy,  H-  0.0187u7i  (A. 4) 

^  (A.5) 

x'm  =  — 10*TO  +  0.004ti;2  (A. 6) 

q  =  l.Oxni  +  0.004u;2  (A. 7) 
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where  Wi  and  are  unit  strength  white-Gaussian  noises,  xj  is  the  wind  state,  is 
the  measurement  noise  state,  ^  is  the  process  noise,  and  7/  is  the  measurement  noise, 
r  is  the  first  column  of  the  plant  A  matrix  given  in  (A.l). 


Appendix  B.  MIMO  HIM  AT  Model 

The  model  is  taken  from  data  for  the  HIM  AT  vehicle  [44].  The  model  is  a 
continuous,  time-invariant  linear  system,  consisting  of  the  four-state  longitudinal 
dynamics.  The  states  are  forward  velocity  perturbation  (5„),  angle  of  attack  (a,), 
pitch  rate  (9),  and  aircraft  attitude  (d,).  The  control  inputs  are  elevon  (Se)  and 
canard  (^c)  the  measured  outputs  are  angle  of  attack  (a)  and  aircraft  attitude 
(ff).  The  plant  is  given  by 

-0.0226  -36.6  -18.90  -32.1  1  [ 

0  -1.90  0.983  0  Or 

0.0123  -11.7  -2.63  0  q 

0  0  1.0  0 

0  0 

-0.414  0 

-77.80  22.40 

0  0 

'  Sv 

0  0  Or 

0  57.3  g 
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The  design  and  truth  model  noise  inputs  are  the  same  as  those  given  in  Ap¬ 
pendix  A  only  with  the  units  on  the  sensor  noise  changed  to  deg^-sec.  The  truth 
model  is  shown  in  Figure  B.l,  where  A,  B,  and  C  are  defined  in  the  normal  way  and 
r  is  the  second  column  of  A. 
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Figure  B.l.  HIM  AT  model  block  diagram 
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